-- Logs begin at Thu 2022-05-26 15:42:18 UTC, end at Thu 2022-05-26 17:22:47 UTC. -- May 26 16:41:17.246578 dv-cinder-836070-4-smb systemd[1]: Starting Devstack devstack@keystone.service... May 26 16:41:17.254699 dv-cinder-836070-4-smb devstack@keystone.service[97415]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:41:17 2022] *** May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: nodename: dv-cinder-836070-4-smb May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: machine: x86_64 May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: clock source: unix May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: pcre jit disabled May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: detected number of CPU cores: 4 May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: current working directory: / May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: detected binary path: /usr/bin/uwsgi-core May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: your processes number limit is 47680 May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: your memory page size is 4096 bytes May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: detected max file descriptor number: 2048 May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: lock engine: pthread robust mutexes May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: thunder lock: enabled May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 16:41:17.259210 dv-cinder-836070-4-smb devstack@keystone.service[97415]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:41:17.303760 dv-cinder-836070-4-smb devstack@keystone.service[97415]: Python main interpreter initialized at 0x56368ddd09c0 May 26 16:41:17.303760 dv-cinder-836070-4-smb devstack@keystone.service[97415]: python threads support enabled May 26 16:41:17.303760 dv-cinder-836070-4-smb devstack@keystone.service[97415]: your server socket listen backlog is limited to 100 connections May 26 16:41:17.303760 dv-cinder-836070-4-smb devstack@keystone.service[97415]: your mercy for graceful operations on workers is 90 seconds May 26 16:41:17.304162 dv-cinder-836070-4-smb devstack@keystone.service[97415]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:41:17.304239 dv-cinder-836070-4-smb devstack@keystone.service[97415]: *** Operational MODE: preforking *** May 26 16:41:17.304487 dv-cinder-836070-4-smb devstack@keystone.service[97415]: *** uWSGI is running in multiple interpreter mode *** May 26 16:41:17.304487 dv-cinder-836070-4-smb devstack@keystone.service[97415]: spawned uWSGI master process (pid: 97415) May 26 16:41:17.304704 dv-cinder-836070-4-smb systemd[1]: Started Devstack devstack@keystone.service. May 26 16:41:17.305833 dv-cinder-836070-4-smb devstack@keystone.service[97415]: spawned uWSGI worker 1 (pid: 97428, cores: 1) May 26 16:41:17.305833 dv-cinder-836070-4-smb devstack@keystone.service[97415]: spawned uWSGI worker 2 (pid: 97429, cores: 1) May 26 16:41:17.305833 dv-cinder-836070-4-smb devstack@keystone.service[97415]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:41:23.735777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:41:23.735777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: from cryptography.utils import int_from_bytes May 26 16:41:23.736635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:41:23.736635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: from cryptography.utils import int_from_bytes May 26 16:41:23.738415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:41:23.738415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: from cryptography.utils import int_from_bytes May 26 16:41:23.738920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:41:23.738920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: from cryptography.utils import int_from_bytes May 26 16:41:23.786878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:41:23.787613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:41:23.787613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] command line args: [] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:41:23.787613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:41:23.788218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ================================================================================ {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:41:23.788218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] admin_token = **** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.788218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] config_dir = [] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.788591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:41:23.788719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.788843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:41:23.789228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] config_source = [] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.789502 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] command line args: [] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:41:23.789673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] debug = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.789673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.790247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:41:23.790247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ================================================================================ {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:41:23.790896 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.791053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] admin_token = **** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.791216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.791370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] config_dir = [] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.791537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.791866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.792034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.792217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] config_source = [] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.792217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] debug = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.792504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] list_limit = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.792504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] log_config_append = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.792811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.792967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.793102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.793224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] log_dir = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.793430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.793604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] log_file = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.793604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.793881 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.794007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.794129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.794129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] list_limit = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.794421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.794539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] log_config_append = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.794727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.794909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.795076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.795208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] log_dir = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.795327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.795452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] log_file = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.795593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.795733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.795862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.795999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.796117 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.796240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.796371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.796501 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.796688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.796857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.796969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.797140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.797259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.797377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.797549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.797663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.797663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.797893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798237 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] publish_errors = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798762 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.798971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.799074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.799180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.799180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.799981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.804443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] standard_threads = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.804570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] publish_errors = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.804771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.804902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] use_journal = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] use_json = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] use_stderr = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.805920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] use_syslog = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.806019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] standard_threads = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.806117 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.806219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.806324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.806436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.806536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.806639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.806739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.806843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] use_journal = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.806843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] use_json = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.807107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.807215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] use_stderr = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.807297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.807422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] use_syslog = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.807501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.807600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:41:23.807692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.807767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.807844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.807915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.807991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.808858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809394 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809660 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.809948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810019 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810455 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810557 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.810986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.811113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.811221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.811321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.811419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.811522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.811674 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.811792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.811902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.812949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.813983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.814982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.815674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.815764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.815834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.815906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.815981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.816986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.817952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.818940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.819959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.820984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.821935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.822983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] auth.external = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.823980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824203 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] auth.password = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] auth.token = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.824961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] auth.external = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] credential.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] auth.password = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] auth.token = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.825936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.826980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.827061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.827216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.827341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.827506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] credential.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.827626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.827800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.827889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.828047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.828142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.828293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.828373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.828642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.828739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.828848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.828933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.829078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] federation.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.829163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.829310 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.829391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.829550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.829640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.829792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.829873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.830016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.830095 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.830266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.830418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.830621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.830712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.830789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.830945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.831038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.831186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.831267 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.831425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.831504 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.831686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] federation.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.831786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.831917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.832004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.832156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.832235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.832397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.832494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.832620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.832699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.832848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.832927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.833082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.833169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.833305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.833384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.833537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.833617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.833780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.833868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.834036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.834139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.834278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.834366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.834510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.834604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.834773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.834910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.835034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.835158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.835277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.835405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.835525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.835701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.835820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.835937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.835937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.836171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.836292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.836410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.836532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.836650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.836767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.836892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.837019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.837138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.837257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.837373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.837490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.837615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.837741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.837859 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.837977 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.838093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.838210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.838337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.838462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.838587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.838742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.838890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.839009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.839135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.839135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.839359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.839476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.839476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.839714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.839844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.839964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.840081 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.840221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.840341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.840459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.840668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.840788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.840905 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.841126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.841245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.841362 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.841581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.841702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.841820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.842053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.842175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.842302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.842409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.842894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.843049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.843193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.843375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.843506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.843708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.843829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.843930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.844030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.844147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.844278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.844398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.844556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.844672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.844773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.844888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.845013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.845140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.845259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.845376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.845493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.845612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.845737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.845856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.845972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.846089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.846234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.846357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.846484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.846602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.846721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.846838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.846955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.847072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.847197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.847316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.847433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.847550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.847685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.847802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.848003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.848125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.848242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.848359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.848482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.848600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.848725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.848845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.848968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.849087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.849203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.849320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.849320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.849549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.849667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.849783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.849900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.850017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.850142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.850261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.850378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.850494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.850610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.850757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.850916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.851036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.851153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.851271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.851388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.851505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.851650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.851771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.851889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.852006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.852123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.852240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.852365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.852484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.852601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.852718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.852835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.852953 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.853078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.853197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.853313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] resource.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.853430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.853547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.853663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.853788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.853913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.854038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.854156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.854273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.854390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.854515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.854633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.854749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.854866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.854982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.855100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.855226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.855345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.855462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.855600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.855719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] role.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.855836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.855970 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] role.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.856091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.856208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.856325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.856442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.856559 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.856684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.856804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.856921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.857039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.857156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.857282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.857401 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.857518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.857634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.857750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.857867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.857993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] resource.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.858111 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.858228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.858345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.858462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.858579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.858704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.858823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.858941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.859063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.859172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.859273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.859380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.859499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.859621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.859621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.859841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.859958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.860086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.860206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] role.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.860324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.860440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] role.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.860557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.860673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.860798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.860917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.861034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.861151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.861269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.861387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.861512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.861631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.861748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.862390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.862515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.862633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.862758 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.862877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.862994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.863110 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.863227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.863343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.863473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.863638 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.863758 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.863893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.864028 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.864146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.864277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.864397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.864516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.864516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] token.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.864702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.864830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.864950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.865067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.865184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.865301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.865417 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.865543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.865662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.865778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.865894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866670 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.866979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.867078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.867176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.867275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.867375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.867483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.867607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.867714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.867814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.867913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.868012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.884717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.884901 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.884994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.connection = **** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] token.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.885948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886393 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.886938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887309 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.887994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:41:23.888138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.connection = **** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.888683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.889210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.889210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:41:23.889210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:41:23.904217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.904444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.904656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.905450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.905682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.905928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.913767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.915138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.943991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.944212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.945100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:23.945330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.005020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.005216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.058073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.058299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.064723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.064952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.137037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.137263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.137381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.137470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.137548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.137685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.137772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.137884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.137977 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.138098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.138194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.138373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.165782 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.165968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.166979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.167072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.167264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.178997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.179471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.191691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.191922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.192123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.192215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.192345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.192430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.192561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.192646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.192773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.192865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.192979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.193070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97429) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.193185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.193395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97428) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:41:24.212332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.212480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.212568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:41:24.212663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:41:24.212801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.212947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.213032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:41:24.213147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:41:24.213244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.213409 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.213574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.213695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.213772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.213891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.213986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.214138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.226091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.226394 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.226515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.226732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.226825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.226973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.227056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.227197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.235098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.235404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.239067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.239341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.239463 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.239642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.239786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.239919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.240052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.240250 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.240383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.240518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.240891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.240891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.241167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.241262 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.241744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.241744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.242002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.242124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.242318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.242449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.242698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.242698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.270778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.272597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.272792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.272916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.274690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.274966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.278174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.278451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.278731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.280376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.280651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.280926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.286683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.286959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.289161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.289435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.291586 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.292001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.292286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.292624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.292907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.293120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.293385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.293939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.294290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.294698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.294980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.295261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.295534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.301811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.301811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.301811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.316029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.316303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.316427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.316622 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.320989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.322644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.324622 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.324993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.326325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.326621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.330061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.331942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.333847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.335580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.337664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.337969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.338253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.338528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.338879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.339163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.339418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.339768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.340064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.340349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.340753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.340912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.359447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.359748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.360010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.360269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.361122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.361407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.361670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.362516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.368939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.370650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.370889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.371049 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.372747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.373020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.374036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.374310 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.374592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.374859 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.375127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.376160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.376463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.376737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.377019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.377291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.388960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.389239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.389526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.389802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.390076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.390375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.390664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.390895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.391182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.391514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.391815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.392119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.392389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.392670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.409932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.411497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.413341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.414802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.416710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.418206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.418699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.419956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.420066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.420229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.420503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.421481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.421767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.422048 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.428598 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.430212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.430357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.431883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.433624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.433908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.434186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.434456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.435141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.435427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.435730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.436007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.444139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.444423 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.444807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.445378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.445663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.446045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.452760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97428) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.453027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.453306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.453573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.453839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.454103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97429) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:41:24.454212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.454386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.454533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.454670 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.454808 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.454962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.455098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.455200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.455293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.455399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.455496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.456190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.456279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.456469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.456617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.456777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97428) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.456915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.457055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.457257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.457513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.457793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.458056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97429) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:41:24.502195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56368ddd09c0 pid: 97428 (default app) May 26 16:41:24.502390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56368ddd09c0 pid: 97429 (default app) May 26 16:41:24.502486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2df38a-7a3e-4dcb-a970-f140f000db94 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:24.502486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2df38a-7a3e-4dcb-a970-f140f000db94 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:24.502706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2df38a-7a3e-4dcb-a970-f140f000db94 None None] PATH_INFO: `/v3` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:24.506878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 791 bytes} [Thu May 26 16:41:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:34.114975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284f028-d61d-4b10-8c6a-2333440174b3 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:34.115542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284f028-d61d-4b10-8c6a-2333440174b3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:34.115542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284f028-d61d-4b10-8c6a-2333440174b3 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:34.121834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1/2] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:41:34.127401 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:34.127867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:34.127994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:34.196816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: INFO dbcounter [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] Registered counter for database keystone May 26 16:41:34.221873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG oslo_db.sqlalchemy.engines [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:41:34.228722 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writer thread running {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:41:34.407808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG passlib.handlers.bcrypt [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=97428) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:41:34.408219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG passlib.handlers.bcrypt [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97428) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:41:34.464417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:34.466034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:34.636495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 2/3] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 26 16:41:34.812265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284f028-d61d-4b10-8c6a-2333440174b3 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:34.882455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: INFO dbcounter [None req-c284f028-d61d-4b10-8c6a-2333440174b3 None None] Registered counter for database keystone May 26 16:41:34.903156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG oslo_db.sqlalchemy.engines [None req-c284f028-d61d-4b10-8c6a-2333440174b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:41:34.909809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writer thread running {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:41:35.032497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284f028-d61d-4b10-8c6a-2333440174b3 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:35.036760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef5c3-ee3e-493b-a89c-4f325f3d3b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:35.037426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef5c3-ee3e-493b-a89c-4f325f3d3b0a admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:35.037712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef5c3-ee3e-493b-a89c-4f325f3d3b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:35.037993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef5c3-ee3e-493b-a89c-4f325f3d3b0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:35.046780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef5c3-ee3e-493b-a89c-4f325f3d3b0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:35.107061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8b3ef5c3-ee3e-493b-a89c-4f325f3d3b0a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:41:35.107389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef5c3-ee3e-493b-a89c-4f325f3d3b0a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:35.118743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 2/4] 10.222.0.93 () {58 vars in 1324 bytes} [Thu May 26 16:41:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:41:35.124969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:35.140288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d184bdf-8572-46b6-bfe0-8a5950534017 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:35.145287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a48a1c-5636-44f5-900b-68710c9fc15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:35.146576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a48a1c-5636-44f5-900b-68710c9fc15a admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:35.146864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a48a1c-5636-44f5-900b-68710c9fc15a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:35.147142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a48a1c-5636-44f5-900b-68710c9fc15a admin admin] PATH_INFO: `/v3/projects/a1dee3d9410543e8a4d913fcc504aee9` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:35.148712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a48a1c-5636-44f5-900b-68710c9fc15a admin admin] RBAC: Authorizing `identity:get_project(project_id=a1dee3d9410543e8a4d913fcc504aee9)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:35.312084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING keystone.common.rbac_enforcer.enforcer [None req-93a48a1c-5636-44f5-900b-68710c9fc15a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:41:35.312340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a48a1c-5636-44f5-900b-68710c9fc15a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:35.317713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 3/5] 10.222.0.93 () {56 vars in 1207 bytes} [Thu May 26 16:41:35 2022] GET /identity/v3/projects/a1dee3d9410543e8a4d913fcc504aee9 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:37.574645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e5dcc-5cf0-49b7-92c3-68335f554420 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:37.575459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e5dcc-5cf0-49b7-92c3-68335f554420 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:37.575676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e5dcc-5cf0-49b7-92c3-68335f554420 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:37.579830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 3/6] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:37.588875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2995-fdf6-4d69-8cac-00cbc725392b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:37.589686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2995-fdf6-4d69-8cac-00cbc725392b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:37.589686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2995-fdf6-4d69-8cac-00cbc725392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:37.608648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b0be2995-fdf6-4d69-8cac-00cbc725392b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:37.610180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b0be2995-fdf6-4d69-8cac-00cbc725392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:37.618115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 4/7] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 16:41:37.641397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e5dcc-5cf0-49b7-92c3-68335f554420 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:37.654411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e5dcc-5cf0-49b7-92c3-68335f554420 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:37.658786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f1260-4a4c-4ca5-b0fe-1f0f17905466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:37.659429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1260-4a4c-4ca5-b0fe-1f0f17905466 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:37.659751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1260-4a4c-4ca5-b0fe-1f0f17905466 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:37.660032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1260-4a4c-4ca5-b0fe-1f0f17905466 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:37.668410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f1260-4a4c-4ca5-b0fe-1f0f17905466 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:37.670201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f1260-4a4c-4ca5-b0fe-1f0f17905466 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:37.679735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 4/8] 10.222.0.93 () {58 vars in 1324 bytes} [Thu May 26 16:41:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:41:37.685547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2995-fdf6-4d69-8cac-00cbc725392b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:37.695472 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2995-fdf6-4d69-8cac-00cbc725392b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:37.699966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff642d-c595-4028-b9f4-819e48b312eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:37.700831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff642d-c595-4028-b9f4-819e48b312eb admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:37.701115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff642d-c595-4028-b9f4-819e48b312eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:37.701388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff642d-c595-4028-b9f4-819e48b312eb admin admin] PATH_INFO: `/v3/users/35335aa619474ed5a5f6b04e6a89efaf` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:37.702794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff642d-c595-4028-b9f4-819e48b312eb admin admin] RBAC: Authorizing `identity:get_user(user_id=35335aa619474ed5a5f6b04e6a89efaf)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:37.704697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff642d-c595-4028-b9f4-819e48b312eb admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:37.706896 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 5/9] 10.222.0.93 () {56 vars in 1198 bytes} [Thu May 26 16:41:37 2022] GET /identity/v3/users/35335aa619474ed5a5f6b04e6a89efaf => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:40.014659 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58d8c-3a23-4150-9fd0-6b4890051800 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.015178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58d8c-3a23-4150-9fd0-6b4890051800 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.015270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58d8c-3a23-4150-9fd0-6b4890051800 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.017205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 5/10] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:40.023610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5495346-97ab-49dc-b545-d4d0a898bca0 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.023914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5495346-97ab-49dc-b545-d4d0a898bca0 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.024024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30119-ff04-4ed8-9038-cf7ffa49b953 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.024566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5495346-97ab-49dc-b545-d4d0a898bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.024711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30119-ff04-4ed8-9038-cf7ffa49b953 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.024711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30119-ff04-4ed8-9038-cf7ffa49b953 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.026168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 6/11] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:40.032510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ebbf-fc8f-4290-afe4-62b6bc30e559 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.032823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ebbf-fc8f-4290-afe4-62b6bc30e559 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.033084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ebbf-fc8f-4290-afe4-62b6bc30e559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.049676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-fd35ebbf-fc8f-4290-afe4-62b6bc30e559 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:40.050855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fd35ebbf-fc8f-4290-afe4-62b6bc30e559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:40.064814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG passlib.handlers.bcrypt [None req-a5495346-97ab-49dc-b545-d4d0a898bca0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=97429) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:41:40.065244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG passlib.handlers.bcrypt [None req-a5495346-97ab-49dc-b545-d4d0a898bca0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97429) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:41:40.112221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-a5495346-97ab-49dc-b545-d4d0a898bca0 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:40.113820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a5495346-97ab-49dc-b545-d4d0a898bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:40.146763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 7/12] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:41:40.169238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ebbf-fc8f-4290-afe4-62b6bc30e559 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.198756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:40.218145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 6/13] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:41:40.241844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5495346-97ab-49dc-b545-d4d0a898bca0 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.284467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ebbf-fc8f-4290-afe4-62b6bc30e559 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.320693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea730d-ece6-4f6f-9fed-3eecb5914487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.321366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea730d-ece6-4f6f-9fed-3eecb5914487 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.321652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea730d-ece6-4f6f-9fed-3eecb5914487 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.321948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea730d-ece6-4f6f-9fed-3eecb5914487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.401764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea730d-ece6-4f6f-9fed-3eecb5914487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.403282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea730d-ece6-4f6f-9fed-3eecb5914487 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.429128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:40.464866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5495346-97ab-49dc-b545-d4d0a898bca0 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.467748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:40.503875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0c1c6-bec0-4ee0-afc6-1d5d6593497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.507625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0c1c6-bec0-4ee0-afc6-1d5d6593497d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.507625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0c1c6-bec0-4ee0-afc6-1d5d6593497d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.507625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0c1c6-bec0-4ee0-afc6-1d5d6593497d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.508078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 8/14] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:41:40.515529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea730d-ece6-4f6f-9fed-3eecb5914487 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.520623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0c1c6-bec0-4ee0-afc6-1d5d6593497d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-1de0c1c6-bec0-4ee0-afc6-1d5d6593497d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:41:40.534221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:41:40.535429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:41:40.536526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 7/15] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:41:40.541674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0c1c6-bec0-4ee0-afc6-1d5d6593497d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.623753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea730d-ece6-4f6f-9fed-3eecb5914487 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.643806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0c1c6-bec0-4ee0-afc6-1d5d6593497d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.647109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:40.659240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b4ee-b0e4-4fda-9608-44e87b762fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.660069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b4ee-b0e4-4fda-9608-44e87b762fdc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.667642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b4ee-b0e4-4fda-9608-44e87b762fdc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.667642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b4ee-b0e4-4fda-9608-44e87b762fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.670981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77b4ee-b0e4-4fda-9608-44e87b762fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.672529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77b4ee-b0e4-4fda-9608-44e87b762fdc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.683730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dbe3a-0b5c-4eda-a22a-858b69cb920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.684401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dbe3a-0b5c-4eda-a22a-858b69cb920f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.684715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dbe3a-0b5c-4eda-a22a-858b69cb920f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.685002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dbe3a-0b5c-4eda-a22a-858b69cb920f None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.687492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dbe3a-0b5c-4eda-a22a-858b69cb920f None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:40.687492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dbe3a-0b5c-4eda-a22a-858b69cb920f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.687733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dbe3a-0b5c-4eda-a22a-858b69cb920f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-eb77b4ee-b0e4-4fda-9608-44e87b762fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:41:40.694374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:41:40.695198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:41:40.696174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:41:40.696174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:41:40.696174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:41:40.696174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:41:40.696174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 9/16] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:41:40.701019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 8/17] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:40.701840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b4ee-b0e4-4fda-9608-44e87b762fdc None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.706386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dbe3a-0b5c-4eda-a22a-858b69cb920f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.735010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:40.807815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dbe3a-0b5c-4eda-a22a-858b69cb920f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.808240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b4ee-b0e4-4fda-9608-44e87b762fdc None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.841908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffa09b-c78d-4cd5-8d07-f184c4b4ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.842121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055ad4-4a66-42a2-b09e-9aed3fcfa4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.842888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055ad4-4a66-42a2-b09e-9aed3fcfa4e9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.843043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffa09b-c78d-4cd5-8d07-f184c4b4ff80 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.843173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055ad4-4a66-42a2-b09e-9aed3fcfa4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.843329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffa09b-c78d-4cd5-8d07-f184c4b4ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.843452 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055ad4-4a66-42a2-b09e-9aed3fcfa4e9 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.843630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffa09b-c78d-4cd5-8d07-f184c4b4ff80 None admin] PATH_INFO: `/v3/users/35335aa619474ed5a5f6b04e6a89efaf` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.844215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb055ad4-4a66-42a2-b09e-9aed3fcfa4e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:40.844520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb055ad4-4a66-42a2-b09e-9aed3fcfa4e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.845847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffa09b-c78d-4cd5-8d07-f184c4b4ff80 None admin] RBAC: Authorizing `identity:get_user(user_id=35335aa619474ed5a5f6b04e6a89efaf)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.846489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb055ad4-4a66-42a2-b09e-9aed3fcfa4e9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.847332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffa09b-c78d-4cd5-8d07-f184c4b4ff80 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.849099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 9/18] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/users/35335aa619474ed5a5f6b04e6a89efaf => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:40.854444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffa09b-c78d-4cd5-8d07-f184c4b4ff80 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.864808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 10/19] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:40.964213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:40.972569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffa09b-c78d-4cd5-8d07-f184c4b4ff80 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.010241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eb749-714c-4c0e-b4ea-2f488e2c7f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.011039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb749-714c-4c0e-b4ea-2f488e2c7f64 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.011327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb749-714c-4c0e-b4ea-2f488e2c7f64 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.011628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb749-714c-4c0e-b4ea-2f488e2c7f64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.013156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eb749-714c-4c0e-b4ea-2f488e2c7f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.014391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eb749-714c-4c0e-b4ea-2f488e2c7f64 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.016138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 10/20] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:41.022806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055ad4-4a66-42a2-b09e-9aed3fcfa4e9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:41.059668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:41.134281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055ad4-4a66-42a2-b09e-9aed3fcfa4e9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.174098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e325b-4e5f-4f11-8176-8c69fae4c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.175056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e325b-4e5f-4f11-8176-8c69fae4c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.175484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e325b-4e5f-4f11-8176-8c69fae4c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.175944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e325b-4e5f-4f11-8176-8c69fae4c6d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.176935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e325b-4e5f-4f11-8176-8c69fae4c6d5 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.domain.id=default, user.id=35335aa619474ed5a5f6b04e6a89efaf) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:41.177246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e325b-4e5f-4f11-8176-8c69fae4c6d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.178726 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e325b-4e5f-4f11-8176-8c69fae4c6d5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.186249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 11/21] 10.222.0.93 () {56 vars in 1322 bytes} [Thu May 26 16:41:41 2022] GET /identity/v3/role_assignments?user.id=35335aa619474ed5a5f6b04e6a89efaf&scope.domain.id=default&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:43.524779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3014d17-d931-4728-ab36-96f6341a71cc None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:43.525787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3014d17-d931-4728-ab36-96f6341a71cc None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:43.526274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3014d17-d931-4728-ab36-96f6341a71cc None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:43.527904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 11/22] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:43.533975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce282483-208b-46ea-8288-29de52c448f4 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:43.534924 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce282483-208b-46ea-8288-29de52c448f4 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:43.535475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce282483-208b-46ea-8288-29de52c448f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:43.565857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ce282483-208b-46ea-8288-29de52c448f4 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:43.567359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ce282483-208b-46ea-8288-29de52c448f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:43.668099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 12/23] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:41:43.699656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3014d17-d931-4728-ab36-96f6341a71cc None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:43.858384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3014d17-d931-4728-ab36-96f6341a71cc None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:43.902172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ce57c-ee69-4cac-a952-5e7a28ab9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:43.902974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ce57c-ee69-4cac-a952-5e7a28ab9e79 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:43.903252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ce57c-ee69-4cac-a952-5e7a28ab9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:43.903527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ce57c-ee69-4cac-a952-5e7a28ab9e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:43.934032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ce57c-ee69-4cac-a952-5e7a28ab9e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:43.935503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ce57c-ee69-4cac-a952-5e7a28ab9e79 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-021ce57c-ee69-4cac-a952-5e7a28ab9e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:41:43.963196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:41:43.964730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:41:43.966324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:41:43.966324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:41:43.966324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:41:43.966324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:41:43.966324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 12/24] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:41:43.973064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce282483-208b-46ea-8288-29de52c448f4 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:44.021378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:44.040307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922c202-22e1-4dc0-9369-b10d9841940a None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:44.041163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922c202-22e1-4dc0-9369-b10d9841940a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:44.041507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922c202-22e1-4dc0-9369-b10d9841940a None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:44.043072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 13/25] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:41:44.048936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748ac05-8fdf-41bb-b1e2-e748ae174e63 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:44.049506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748ac05-8fdf-41bb-b1e2-e748ae174e63 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:44.049846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748ac05-8fdf-41bb-b1e2-e748ae174e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:44.084800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-8748ac05-8fdf-41bb-b1e2-e748ae174e63 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:44.086359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8748ac05-8fdf-41bb-b1e2-e748ae174e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:44.102373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:44.122558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce282483-208b-46ea-8288-29de52c448f4 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:44.167448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c665e-f713-462e-9a56-2b0d6564f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:44.168295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c665e-f713-462e-9a56-2b0d6564f9ad None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:44.168951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c665e-f713-462e-9a56-2b0d6564f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:44.169426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c665e-f713-462e-9a56-2b0d6564f9ad None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:44.170377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c665e-f713-462e-9a56-2b0d6564f9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:44.171040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c665e-f713-462e-9a56-2b0d6564f9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:44.173168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c665e-f713-462e-9a56-2b0d6564f9ad None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:44.191435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 13/26] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:44.196993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c665e-f713-462e-9a56-2b0d6564f9ad None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:44.219183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 14/27] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:41:44.258752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748ac05-8fdf-41bb-b1e2-e748ae174e63 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:44.388009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:44.405896 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c665e-f713-462e-9a56-2b0d6564f9ad None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:44.422171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748ac05-8fdf-41bb-b1e2-e748ae174e63 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:44.458574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf42a4-4194-4987-b002-9baa27d7961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:44.459596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf42a4-4194-4987-b002-9baa27d7961f None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:44.460024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf42a4-4194-4987-b002-9baa27d7961f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:44.460488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf42a4-4194-4987-b002-9baa27d7961f None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:44.461374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf42a4-4194-4987-b002-9baa27d7961f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:44.463036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf42a4-4194-4987-b002-9baa27d7961f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:44.470935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe14043-0eeb-4976-be33-0a7e9faec882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:44.471618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe14043-0eeb-4976-be33-0a7e9faec882 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:44.472374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe14043-0eeb-4976-be33-0a7e9faec882 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:44.473027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe14043-0eeb-4976-be33-0a7e9faec882 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:44.474642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe14043-0eeb-4976-be33-0a7e9faec882 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:44.480417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe14043-0eeb-4976-be33-0a7e9faec882 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:44.735549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 15/28] 10.222.0.93 () {60 vars in 1131 bytes} [Thu May 26 16:41:44 2022] POST /identity/v3/roles => generated 219 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:44.736879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8696-5b9d-4d64-8673-ae33720a94cd None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:44.737177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8696-5b9d-4d64-8673-ae33720a94cd None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:44.737487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8696-5b9d-4d64-8673-ae33720a94cd None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:44.740557 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 16/29] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:44.740557 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a537fbc-fcc9-4134-aed4-e1d63a46bae7 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:44.740743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a537fbc-fcc9-4134-aed4-e1d63a46bae7 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:44.741062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a537fbc-fcc9-4134-aed4-e1d63a46bae7 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:44.745474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 17/30] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:44.749565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba43d0-c05a-4b5e-bd9f-85970a6a1a16 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:44.749565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba43d0-c05a-4b5e-bd9f-85970a6a1a16 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:44.749565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba43d0-c05a-4b5e-bd9f-85970a6a1a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:44.756518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:44.771468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-89ba43d0-c05a-4b5e-bd9f-85970a6a1a16 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:44.773591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-89ba43d0-c05a-4b5e-bd9f-85970a6a1a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:44.818599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 14/31] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:41:44 2022] POST /identity/v3/projects => generated 301 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:44.820130 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a5ea5-e86d-4ef7-82a3-b4635dd695e7 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:44.820397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a5ea5-e86d-4ef7-82a3-b4635dd695e7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:44.820683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a5ea5-e86d-4ef7-82a3-b4635dd695e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:44.843319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f70a5ea5-e86d-4ef7-82a3-b4635dd695e7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:44.845142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f70a5ea5-e86d-4ef7-82a3-b4635dd695e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:44.955710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 15/32] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:41:44.973623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 18/33] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:41:45.014519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a5ea5-e86d-4ef7-82a3-b4635dd695e7 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:45.018475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba43d0-c05a-4b5e-bd9f-85970a6a1a16 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:45.139429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:45.150667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba43d0-c05a-4b5e-bd9f-85970a6a1a16 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:45.182565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a5ea5-e86d-4ef7-82a3-b4635dd695e7 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:45.193105 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab1de6-9b32-4ecb-89ed-a9eb06a0c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:45.193921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab1de6-9b32-4ecb-89ed-a9eb06a0c22d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.194212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab1de6-9b32-4ecb-89ed-a9eb06a0c22d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.194492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab1de6-9b32-4ecb-89ed-a9eb06a0c22d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.198422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:45.224298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab1de6-9b32-4ecb-89ed-a9eb06a0c22d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-4fab1de6-9b32-4ecb-89ed-a9eb06a0c22d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:41:45.230288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:41:45.231357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:41:45.232634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 19/34] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:41:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:41:45.233517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d8f6-577e-4688-be6a-a85aa1aa95d4 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.233517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d8f6-577e-4688-be6a-a85aa1aa95d4 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.233517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d8f6-577e-4688-be6a-a85aa1aa95d4 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.234969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 20/35] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:45.236388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efe08a-99bc-4163-b80f-912035989a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:45.237578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe08a-99bc-4163-b80f-912035989a6d None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.237578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe08a-99bc-4163-b80f-912035989a6d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.237578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe08a-99bc-4163-b80f-912035989a6d None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.238363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efe08a-99bc-4163-b80f-912035989a6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:45.240294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efe08a-99bc-4163-b80f-912035989a6d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:45.241038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7107ba-43d0-4bfc-962d-71af0d5834d0 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.241338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7107ba-43d0-4bfc-962d-71af0d5834d0 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.241626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7107ba-43d0-4bfc-962d-71af0d5834d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.260416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-bb7107ba-43d0-4bfc-962d-71af0d5834d0 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:45.261582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bb7107ba-43d0-4bfc-962d-71af0d5834d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:45.329080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 21/36] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:41:45.330422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7107ba-43d0-4bfc-962d-71af0d5834d0 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:45.343173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 16/37] 10.222.0.93 () {60 vars in 1131 bytes} [Thu May 26 16:41:45 2022] POST /identity/v3/roles => generated 225 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:45.343173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2217b6-77ab-479c-ac53-dd3516c33134 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.343173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2217b6-77ab-479c-ac53-dd3516c33134 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.343173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2217b6-77ab-479c-ac53-dd3516c33134 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.343173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 17/38] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:45.349547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855be4e0-f430-474a-be2b-86a430f4dcdf None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.358887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855be4e0-f430-474a-be2b-86a430f4dcdf None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.358887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855be4e0-f430-474a-be2b-86a430f4dcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.370986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-855be4e0-f430-474a-be2b-86a430f4dcdf None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:45.372406 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-855be4e0-f430-474a-be2b-86a430f4dcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:45.450324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7107ba-43d0-4bfc-962d-71af0d5834d0 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:45.454656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 18/39] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:41:45.460052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855be4e0-f430-474a-be2b-86a430f4dcdf None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:45.484458 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:45.497205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db193f-6a99-4863-b19d-9d1fae23d596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:45.497899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db193f-6a99-4863-b19d-9d1fae23d596 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.502330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db193f-6a99-4863-b19d-9d1fae23d596 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.502330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db193f-6a99-4863-b19d-9d1fae23d596 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.502330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db193f-6a99-4863-b19d-9d1fae23d596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:45.502330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db193f-6a99-4863-b19d-9d1fae23d596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:45.502330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db193f-6a99-4863-b19d-9d1fae23d596 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:45.511549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 22/40] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:41:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:45.512457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db193f-6a99-4863-b19d-9d1fae23d596 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:45.538904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:45.586160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855be4e0-f430-474a-be2b-86a430f4dcdf None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:45.619751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e5e23-ad00-4bd9-96f9-c29f83f7c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:45.620410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e5e23-ad00-4bd9-96f9-c29f83f7c62c None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.620692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e5e23-ad00-4bd9-96f9-c29f83f7c62c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.620965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e5e23-ad00-4bd9-96f9-c29f83f7c62c None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.621704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e5e23-ad00-4bd9-96f9-c29f83f7c62c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:45.623102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e5e23-ad00-4bd9-96f9-c29f83f7c62c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:45.635125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db193f-6a99-4863-b19d-9d1fae23d596 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:45.668602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1a14d-ba49-4581-b1c0-5f264962b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:45.669379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1a14d-ba49-4581-b1c0-5f264962b472 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.669667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1a14d-ba49-4581-b1c0-5f264962b472 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.669944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1a14d-ba49-4581-b1c0-5f264962b472 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.671126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1a14d-ba49-4581-b1c0-5f264962b472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:45.672645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1a14d-ba49-4581-b1c0-5f264962b472 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:45.674912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 23/41] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:41:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:45.675722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1a14d-ba49-4581-b1c0-5f264962b472 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:45.731201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:45.752445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 19/42] 10.222.0.93 () {60 vars in 1131 bytes} [Thu May 26 16:41:45 2022] POST /identity/v3/roles => generated 223 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:45.752445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e5e23-ad00-4bd9-96f9-c29f83f7c62c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:45.776382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1a14d-ba49-4581-b1c0-5f264962b472 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:45.818005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b6a20-d044-42ec-9170-31d591e8e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:45.818923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b6a20-d044-42ec-9170-31d591e8e685 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.823255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b6a20-d044-42ec-9170-31d591e8e685 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.823255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b6a20-d044-42ec-9170-31d591e8e685 None admin] PATH_INFO: `/v3/users/35335aa619474ed5a5f6b04e6a89efaf` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.823255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b6a20-d044-42ec-9170-31d591e8e685 None admin] RBAC: Authorizing `identity:get_user(user_id=35335aa619474ed5a5f6b04e6a89efaf)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:45.823255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b6a20-d044-42ec-9170-31d591e8e685 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:45.824297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 24/43] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:41:45 2022] GET /identity/v3/users/35335aa619474ed5a5f6b04e6a89efaf => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:45.829991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b6a20-d044-42ec-9170-31d591e8e685 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:45.882048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e5e23-ad00-4bd9-96f9-c29f83f7c62c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:45.904562 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:45.920050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663334e7-8ac2-418a-9844-0ee24a1d342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:45.920747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663334e7-8ac2-418a-9844-0ee24a1d342f None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.921044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663334e7-8ac2-418a-9844-0ee24a1d342f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.921328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663334e7-8ac2-418a-9844-0ee24a1d342f None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.922070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663334e7-8ac2-418a-9844-0ee24a1d342f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:45.924164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663334e7-8ac2-418a-9844-0ee24a1d342f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:45.957726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b6a20-d044-42ec-9170-31d591e8e685 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:45.981137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:45.992976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f6487-8362-427d-85c0-84d5fe951232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:45.993774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f6487-8362-427d-85c0-84d5fe951232 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:45.994056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f6487-8362-427d-85c0-84d5fe951232 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:45.994332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f6487-8362-427d-85c0-84d5fe951232 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:45.995629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f6487-8362-427d-85c0-84d5fe951232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:45.997019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f6487-8362-427d-85c0-84d5fe951232 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:45.998630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 25/44] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:41:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:46.004218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f6487-8362-427d-85c0-84d5fe951232 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:46.014935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 20/45] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:41:45 2022] POST /identity/v3/projects => generated 312 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:46.114762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f6487-8362-427d-85c0-84d5fe951232 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:46.150363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1063bd-78b0-403a-8674-22ae50d93e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:46.151257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1063bd-78b0-403a-8674-22ae50d93e75 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:46.151544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1063bd-78b0-403a-8674-22ae50d93e75 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:46.151921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1063bd-78b0-403a-8674-22ae50d93e75 None admin] PATH_INFO: `/v3/domains/default/users/35335aa619474ed5a5f6b04e6a89efaf/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:46.154313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1063bd-78b0-403a-8674-22ae50d93e75 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=35335aa619474ed5a5f6b04e6a89efaf, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:46.155930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1063bd-78b0-403a-8674-22ae50d93e75 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:46.274563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 26/46] 10.222.0.93 () {58 vars in 1361 bytes} [Thu May 26 16:41:46 2022] PUT /identity/v3/domains/default/users/35335aa619474ed5a5f6b04e6a89efaf/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:48.243698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73d5a0-490e-45a2-9c39-9a8a70caac8f None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.244310 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73d5a0-490e-45a2-9c39-9a8a70caac8f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.244310 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73d5a0-490e-45a2-9c39-9a8a70caac8f None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.245721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 21/47] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:48.251670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4876-3e70-42e7-bdb5-d6e78ece5813 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.252099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4876-3e70-42e7-bdb5-d6e78ece5813 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.252305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4876-3e70-42e7-bdb5-d6e78ece5813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.272774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-dedb4876-3e70-42e7-bdb5-d6e78ece5813 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:48.274006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-dedb4876-3e70-42e7-bdb5-d6e78ece5813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:48.325802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:48.347428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 27/48] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:41:48.370600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73d5a0-490e-45a2-9c39-9a8a70caac8f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:48.457679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0070cf-682e-4a59-8cf3-5d46a07ab04f None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.457679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0070cf-682e-4a59-8cf3-5d46a07ab04f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.457679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0070cf-682e-4a59-8cf3-5d46a07ab04f None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.458811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 28/49] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:48.465139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e26f6-5c6a-4ef0-8e7f-c42c1baefec6 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.465437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e26f6-5c6a-4ef0-8e7f-c42c1baefec6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.465723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e26f6-5c6a-4ef0-8e7f-c42c1baefec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.479103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73d5a0-490e-45a2-9c39-9a8a70caac8f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:48.484876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-600e26f6-5c6a-4ef0-8e7f-c42c1baefec6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:48.486544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-600e26f6-5c6a-4ef0-8e7f-c42c1baefec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:48.515882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a9065-5668-4c93-86df-107147b2b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:48.516595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a9065-5668-4c93-86df-107147b2b909 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.517015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a9065-5668-4c93-86df-107147b2b909 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.517296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a9065-5668-4c93-86df-107147b2b909 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.518526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a9065-5668-4c93-86df-107147b2b909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:48.520030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a9065-5668-4c93-86df-107147b2b909 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:48.521939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 22/50] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:41:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:48.527534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a9065-5668-4c93-86df-107147b2b909 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:48.559324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 29/51] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:41:48.570288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:48.582933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e26f6-5c6a-4ef0-8e7f-c42c1baefec6 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:48.625700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a9065-5668-4c93-86df-107147b2b909 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:48.664186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61664c4e-7328-4079-91a8-6083c2d13566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:48.664878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61664c4e-7328-4079-91a8-6083c2d13566 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.665123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61664c4e-7328-4079-91a8-6083c2d13566 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.665398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61664c4e-7328-4079-91a8-6083c2d13566 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.666120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61664c4e-7328-4079-91a8-6083c2d13566 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:48.667619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61664c4e-7328-4079-91a8-6083c2d13566 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:48.687418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e26f6-5c6a-4ef0-8e7f-c42c1baefec6 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:48.699103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:48.721919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a75de-820a-4f9e-83f5-5fb1005fe06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:48.722708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a75de-820a-4f9e-83f5-5fb1005fe06d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.722995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a75de-820a-4f9e-83f5-5fb1005fe06d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.723272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a75de-820a-4f9e-83f5-5fb1005fe06d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.732924 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a75de-820a-4f9e-83f5-5fb1005fe06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-9f3a75de-820a-4f9e-83f5-5fb1005fe06d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:41:48.740974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:41:48.741972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:41:48.742800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 30/52] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:41:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:41:48.747770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a75de-820a-4f9e-83f5-5fb1005fe06d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:48.849618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a75de-820a-4f9e-83f5-5fb1005fe06d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:48.881970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70086d6-3ac7-4cdd-9542-6c98a5e00c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:48.882632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70086d6-3ac7-4cdd-9542-6c98a5e00c77 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.882916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70086d6-3ac7-4cdd-9542-6c98a5e00c77 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.883193 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70086d6-3ac7-4cdd-9542-6c98a5e00c77 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.883967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70086d6-3ac7-4cdd-9542-6c98a5e00c77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:48.884273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70086d6-3ac7-4cdd-9542-6c98a5e00c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:48.885667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70086d6-3ac7-4cdd-9542-6c98a5e00c77 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:48.893969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 31/53] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:48.899592 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70086d6-3ac7-4cdd-9542-6c98a5e00c77 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:48.916060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 23/54] 10.222.0.93 () {60 vars in 1140 bytes} [Thu May 26 16:41:48 2022] POST /identity/v3/projects => generated 298 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:48.959454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:49.007161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70086d6-3ac7-4cdd-9542-6c98a5e00c77 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:49.044661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5f2f-f1d7-4d21-a45c-af15276de8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:49.045561 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5f2f-f1d7-4d21-a45c-af15276de8cf None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:49.045880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5f2f-f1d7-4d21-a45c-af15276de8cf None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:49.046161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5f2f-f1d7-4d21-a45c-af15276de8cf None admin] PATH_INFO: `/v3/users/35335aa619474ed5a5f6b04e6a89efaf` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:49.047451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c5f2f-f1d7-4d21-a45c-af15276de8cf None admin] RBAC: Authorizing `identity:get_user(user_id=35335aa619474ed5a5f6b04e6a89efaf)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:49.049571 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c5f2f-f1d7-4d21-a45c-af15276de8cf None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:49.051412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 32/55] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:41:48 2022] GET /identity/v3/users/35335aa619474ed5a5f6b04e6a89efaf => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:49.057378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61664c4e-7328-4079-91a8-6083c2d13566 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:49.155634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:49.165150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61664c4e-7328-4079-91a8-6083c2d13566 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:49.198592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ff955-364e-4b26-a1e5-11eaeaecaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:49.199399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ff955-364e-4b26-a1e5-11eaeaecaf7d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:49.199712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ff955-364e-4b26-a1e5-11eaeaecaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:49.199985 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ff955-364e-4b26-a1e5-11eaeaecaf7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:49.201166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ff955-364e-4b26-a1e5-11eaeaecaf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:49.202628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ff955-364e-4b26-a1e5-11eaeaecaf7d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:49.209684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 24/56] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:41:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:49.210926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5f2f-f1d7-4d21-a45c-af15276de8cf None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:49.311162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:49.314136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5f2f-f1d7-4d21-a45c-af15276de8cf None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:49.348996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6bf64-1a07-424b-b59a-5e01e9c9617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:49.349654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6bf64-1a07-424b-b59a-5e01e9c9617e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:49.349944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6bf64-1a07-424b-b59a-5e01e9c9617e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:49.350229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6bf64-1a07-424b-b59a-5e01e9c9617e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:49.357075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6bf64-1a07-424b-b59a-5e01e9c9617e None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.domain.id=default, user.id=35335aa619474ed5a5f6b04e6a89efaf) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:49.357075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6bf64-1a07-424b-b59a-5e01e9c9617e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:49.357075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6bf64-1a07-424b-b59a-5e01e9c9617e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:49.361091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 33/57] 10.222.0.93 () {56 vars in 1322 bytes} [Thu May 26 16:41:49 2022] GET /identity/v3/role_assignments?user.id=35335aa619474ed5a5f6b04e6a89efaf&scope.domain.id=default&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:51.166756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327296c9-b282-4fa8-a0b7-c098198d3218 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.167250 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327296c9-b282-4fa8-a0b7-c098198d3218 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.167250 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327296c9-b282-4fa8-a0b7-c098198d3218 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.168671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 25/58] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:51.174182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044eee50-915d-426a-9182-9533a13e89c7 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.174576 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044eee50-915d-426a-9182-9533a13e89c7 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.174740 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044eee50-915d-426a-9182-9533a13e89c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.191625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-044eee50-915d-426a-9182-9533a13e89c7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:51.192801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-044eee50-915d-426a-9182-9533a13e89c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:51.255967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 34/59] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:41:51.280563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327296c9-b282-4fa8-a0b7-c098198d3218 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.377503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327296c9-b282-4fa8-a0b7-c098198d3218 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.410113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684178c-e92f-42bc-9264-405dab985918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.410888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684178c-e92f-42bc-9264-405dab985918 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.411168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684178c-e92f-42bc-9264-405dab985918 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.411437 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684178c-e92f-42bc-9264-405dab985918 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.412632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684178c-e92f-42bc-9264-405dab985918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.414331 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684178c-e92f-42bc-9264-405dab985918 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.416383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 26/60] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:41:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:51.422097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044eee50-915d-426a-9182-9533a13e89c7 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.512288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:51.518950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044eee50-915d-426a-9182-9533a13e89c7 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.552579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45dc05-3097-4de3-ac0d-4dff4153e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.553310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45dc05-3097-4de3-ac0d-4dff4153e421 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.553602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45dc05-3097-4de3-ac0d-4dff4153e421 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.553879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45dc05-3097-4de3-ac0d-4dff4153e421 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.554578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45dc05-3097-4de3-ac0d-4dff4153e421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.556207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45dc05-3097-4de3-ac0d-4dff4153e421 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.714539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 35/61] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:41:51 2022] POST /identity/v3/users => generated 275 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:55.288790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503afdf-ff04-4657-ac7c-9ca73bb918b8 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.289669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503afdf-ff04-4657-ac7c-9ca73bb918b8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.290110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503afdf-ff04-4657-ac7c-9ca73bb918b8 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.291659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 27/62] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:55.298195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e1bb-f13e-4b4f-9ad6-f49de9c7940a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.299099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e1bb-f13e-4b4f-9ad6-f49de9c7940a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.299543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e1bb-f13e-4b4f-9ad6-f49de9c7940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.329356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e1e1e1bb-f13e-4b4f-9ad6-f49de9c7940a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:55.330874 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e1e1e1bb-f13e-4b4f-9ad6-f49de9c7940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:55.421930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 36/63] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:41:55.426403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693ff5-0dcb-4255-a655-eef447919dae None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.426852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693ff5-0dcb-4255-a655-eef447919dae None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.427295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693ff5-0dcb-4255-a655-eef447919dae None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.428844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 28/64] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:55.434361 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ec884-1e83-4653-848e-c1ced4582e1a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.434821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ec884-1e83-4653-848e-c1ced4582e1a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.435242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ec884-1e83-4653-848e-c1ced4582e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.440658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7dce8-8782-4c8f-a44f-7085d99f5af3 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.441139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7dce8-8782-4c8f-a44f-7085d99f5af3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.441555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7dce8-8782-4c8f-a44f-7085d99f5af3 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.444017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 29/65] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:55.450783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29034c76-ee85-46e5-a123-7afeebb316d0 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.450783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29034c76-ee85-46e5-a123-7afeebb316d0 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.450783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29034c76-ee85-46e5-a123-7afeebb316d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.469170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9d2ec884-1e83-4653-848e-c1ced4582e1a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:55.470920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9d2ec884-1e83-4653-848e-c1ced4582e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:55.473282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-29034c76-ee85-46e5-a123-7afeebb316d0 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:55.475789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-29034c76-ee85-46e5-a123-7afeebb316d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:55.507118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:55.554171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 37/66] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:41:55.554957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ec884-1e83-4653-848e-c1ced4582e1a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:55.564205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 30/67] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:41:55.572279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5de26-0d9a-4d8a-a5b0-0b0d4d3fabc8 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.572279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5de26-0d9a-4d8a-a5b0-0b0d4d3fabc8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.572279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5de26-0d9a-4d8a-a5b0-0b0d4d3fabc8 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.576551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 31/68] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:55.577073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:55.577933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e16ea7-25d7-4dfe-9756-42493c9f1ec9 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.578091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e16ea7-25d7-4dfe-9756-42493c9f1ec9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.578372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e16ea7-25d7-4dfe-9756-42493c9f1ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.598800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c4e16ea7-25d7-4dfe-9756-42493c9f1ec9 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:55.600277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c4e16ea7-25d7-4dfe-9756-42493c9f1ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:55.670750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ec884-1e83-4653-848e-c1ced4582e1a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:55.672876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 32/69] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:41:55.680493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e16ea7-25d7-4dfe-9756-42493c9f1ec9 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:55.718295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ecc50-8468-4827-9689-b34d09ef389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:55.719100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ecc50-8468-4827-9689-b34d09ef389f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.719387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ecc50-8468-4827-9689-b34d09ef389f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.719740 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ecc50-8468-4827-9689-b34d09ef389f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.732440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ecc50-8468-4827-9689-b34d09ef389f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-863ecc50-8468-4827-9689-b34d09ef389f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:41:55.740577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:41:55.741574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:41:55.742340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 38/70] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:41:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:41:55.743657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ecc50-8468-4827-9689-b34d09ef389f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:55.782122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:55.794550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e16ea7-25d7-4dfe-9756-42493c9f1ec9 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:55.821511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:55.836428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d0e66-d7a2-47a4-8662-8eb8488dadc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:55.840099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d0e66-d7a2-47a4-8662-8eb8488dadc1 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.840502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d0e66-d7a2-47a4-8662-8eb8488dadc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.840805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d0e66-d7a2-47a4-8662-8eb8488dadc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.856268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d0e66-d7a2-47a4-8662-8eb8488dadc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:41:55.861703 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ecc50-8468-4827-9689-b34d09ef389f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-b07d0e66-d7a2-47a4-8662-8eb8488dadc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:41:55.865424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:41:55.866315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:41:55.867069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:41:55.871633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 33/71] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:41:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:41:55.872576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d0e66-d7a2-47a4-8662-8eb8488dadc1 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:55.904717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0699f07-2811-4bef-9543-dc25159c96da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:55.905752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0699f07-2811-4bef-9543-dc25159c96da None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.905865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0699f07-2811-4bef-9543-dc25159c96da None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.906074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0699f07-2811-4bef-9543-dc25159c96da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.916729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0699f07-2811-4bef-9543-dc25159c96da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-e0699f07-2811-4bef-9543-dc25159c96da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:41:55.925331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:41:55.926388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:41:55.927189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 39/72] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:41:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:41:55.928004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0699f07-2811-4bef-9543-dc25159c96da None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:55.991781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d0e66-d7a2-47a4-8662-8eb8488dadc1 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.030062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773aa0-721b-4038-b4d6-cd077bf91901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.030862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773aa0-721b-4038-b4d6-cd077bf91901 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.031199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773aa0-721b-4038-b4d6-cd077bf91901 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.031485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773aa0-721b-4038-b4d6-cd077bf91901 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.036388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0699f07-2811-4bef-9543-dc25159c96da None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.042185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42773aa0-721b-4038-b4d6-cd077bf91901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-42773aa0-721b-4038-b4d6-cd077bf91901 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:41:56.050394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:41:56.051261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 34/73] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:41:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:41:56.052480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773aa0-721b-4038-b4d6-cd077bf91901 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.064199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.073693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.077758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a1cf1-4495-4f50-b1a7-c2fc4a824c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.078430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a1cf1-4495-4f50-b1a7-c2fc4a824c71 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.078720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a1cf1-4495-4f50-b1a7-c2fc4a824c71 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.079035 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a1cf1-4495-4f50-b1a7-c2fc4a824c71 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.079827 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a1cf1-4495-4f50-b1a7-c2fc4a824c71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:56.080139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a1cf1-4495-4f50-b1a7-c2fc4a824c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.081556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a1cf1-4495-4f50-b1a7-c2fc4a824c71 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.090436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 40/74] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:41:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:56.091254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a1cf1-4495-4f50-b1a7-c2fc4a824c71 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.156649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773aa0-721b-4038-b4d6-cd077bf91901 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.188178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a1cf1-4495-4f50-b1a7-c2fc4a824c71 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.190711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32060f-9f71-4377-8070-5a5dc80a82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.191771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32060f-9f71-4377-8070-5a5dc80a82a9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.192059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32060f-9f71-4377-8070-5a5dc80a82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.192341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32060f-9f71-4377-8070-5a5dc80a82a9 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.193093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32060f-9f71-4377-8070-5a5dc80a82a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:56.193476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32060f-9f71-4377-8070-5a5dc80a82a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.195130 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32060f-9f71-4377-8070-5a5dc80a82a9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.208544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 35/75] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:56.209851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c569a48-8362-4df5-b7f8-7c7253f07e79 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.210165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c569a48-8362-4df5-b7f8-7c7253f07e79 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.210445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c569a48-8362-4df5-b7f8-7c7253f07e79 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.215445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 36/76] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:41:56.215445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c569a48-8362-4df5-b7f8-7c7253f07e79 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.234768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d14270-c71c-48a4-b39a-27cf57cc246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.235486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d14270-c71c-48a4-b39a-27cf57cc246e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.235797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d14270-c71c-48a4-b39a-27cf57cc246e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.236077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d14270-c71c-48a4-b39a-27cf57cc246e None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.236818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d14270-c71c-48a4-b39a-27cf57cc246e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:56.237124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d14270-c71c-48a4-b39a-27cf57cc246e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.238517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d14270-c71c-48a4-b39a-27cf57cc246e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.247135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 41/77] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:56.248008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d14270-c71c-48a4-b39a-27cf57cc246e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.288857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.303649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.320164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c569a48-8362-4df5-b7f8-7c7253f07e79 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.346923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d14270-c71c-48a4-b39a-27cf57cc246e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.353449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0422c-3bc5-4ccd-9c8c-3bd64dc2c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.354111 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0422c-3bc5-4ccd-9c8c-3bd64dc2c9ec None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.354391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0422c-3bc5-4ccd-9c8c-3bd64dc2c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.354665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0422c-3bc5-4ccd-9c8c-3bd64dc2c9ec None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.355505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0422c-3bc5-4ccd-9c8c-3bd64dc2c9ec None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:56.356060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0422c-3bc5-4ccd-9c8c-3bd64dc2c9ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.357738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0422c-3bc5-4ccd-9c8c-3bd64dc2c9ec None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.366392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 37/78] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:56.368582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0422c-3bc5-4ccd-9c8c-3bd64dc2c9ec None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.380737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fb921-9006-4d8c-ac6a-cc7fc89fc9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.381612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fb921-9006-4d8c-ac6a-cc7fc89fc9ea None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.381897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fb921-9006-4d8c-ac6a-cc7fc89fc9ea None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.382177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fb921-9006-4d8c-ac6a-cc7fc89fc9ea None admin] PATH_INFO: `/v3/users/35335aa619474ed5a5f6b04e6a89efaf` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.383378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fb921-9006-4d8c-ac6a-cc7fc89fc9ea None admin] RBAC: Authorizing `identity:get_user(user_id=35335aa619474ed5a5f6b04e6a89efaf)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.384872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fb921-9006-4d8c-ac6a-cc7fc89fc9ea None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.386494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 42/79] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/users/35335aa619474ed5a5f6b04e6a89efaf => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:56.387718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78812ba3-824f-4fc4-a139-151572091717 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.388009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78812ba3-824f-4fc4-a139-151572091717 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.388294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78812ba3-824f-4fc4-a139-151572091717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.404882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-78812ba3-824f-4fc4-a139-151572091717 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:56.406070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-78812ba3-824f-4fc4-a139-151572091717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:56.473709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0422c-3bc5-4ccd-9c8c-3bd64dc2c9ec None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.474455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 43/80] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:41:56.475306 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78812ba3-824f-4fc4-a139-151572091717 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.518371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.523191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965cac-fa24-402b-b520-a704819675d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.524165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965cac-fa24-402b-b520-a704819675d1 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.524449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965cac-fa24-402b-b520-a704819675d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.524726 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965cac-fa24-402b-b520-a704819675d1 None admin] PATH_INFO: `/v3/users/f0bc925e5a06416393e984ad52522227` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.530902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.538119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9965cac-fa24-402b-b520-a704819675d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc925e5a06416393e984ad52522227)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.539636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9965cac-fa24-402b-b520-a704819675d1 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.541378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 38/81] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/users/f0bc925e5a06416393e984ad52522227 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:56.541378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965cac-fa24-402b-b520-a704819675d1 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.578551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78812ba3-824f-4fc4-a139-151572091717 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.614086 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e9dc0-d960-4ec8-8406-5c94bb26afab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.614870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e9dc0-d960-4ec8-8406-5c94bb26afab None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.615158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e9dc0-d960-4ec8-8406-5c94bb26afab None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.615435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e9dc0-d960-4ec8-8406-5c94bb26afab None admin] PATH_INFO: `/v3/users/f0bc925e5a06416393e984ad52522227` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.616677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e9dc0-d960-4ec8-8406-5c94bb26afab None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc925e5a06416393e984ad52522227)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.618155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e9dc0-d960-4ec8-8406-5c94bb26afab None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.619833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 44/82] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/users/f0bc925e5a06416393e984ad52522227 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:56.620604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e9dc0-d960-4ec8-8406-5c94bb26afab None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.662918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965cac-fa24-402b-b520-a704819675d1 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.700733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d446b8-7080-4adc-b229-ff3b1b4ab262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.701600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d446b8-7080-4adc-b229-ff3b1b4ab262 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.701884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d446b8-7080-4adc-b229-ff3b1b4ab262 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.702160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d446b8-7080-4adc-b229-ff3b1b4ab262 None admin] PATH_INFO: `/v3/users/f0bc925e5a06416393e984ad52522227` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.703345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d446b8-7080-4adc-b229-ff3b1b4ab262 None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc925e5a06416393e984ad52522227)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.704913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d446b8-7080-4adc-b229-ff3b1b4ab262 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.706537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 39/83] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/users/f0bc925e5a06416393e984ad52522227 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:56.707286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d446b8-7080-4adc-b229-ff3b1b4ab262 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.726170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e9dc0-d960-4ec8-8406-5c94bb26afab None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.747839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.762252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f5696-e93d-43a7-92ba-4fa4ed623e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.762893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f5696-e93d-43a7-92ba-4fa4ed623e82 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.763169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f5696-e93d-43a7-92ba-4fa4ed623e82 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.763449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f5696-e93d-43a7-92ba-4fa4ed623e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.766986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.811999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d446b8-7080-4adc-b229-ff3b1b4ab262 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.830479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f5696-e93d-43a7-92ba-4fa4ed623e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.832002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f5696-e93d-43a7-92ba-4fa4ed623e82 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.846575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aac082-c6bb-470f-8595-c003c69ca85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.847366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aac082-c6bb-470f-8595-c003c69ca85e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.847678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aac082-c6bb-470f-8595-c003c69ca85e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.847954 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aac082-c6bb-470f-8595-c003c69ca85e None admin] PATH_INFO: `/v3/domains/default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.849133 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aac082-c6bb-470f-8595-c003c69ca85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.850564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aac082-c6bb-470f-8595-c003c69ca85e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.857031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 40/84] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:56.858667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aac082-c6bb-470f-8595-c003c69ca85e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.939170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 45/85] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:41:56.940079 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f5696-e93d-43a7-92ba-4fa4ed623e82 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.960688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aac082-c6bb-470f-8595-c003c69ca85e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.961211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.986548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.994920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538807-55ab-4a65-94f1-29ecb73754ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.995599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538807-55ab-4a65-94f1-29ecb73754ae None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.995888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538807-55ab-4a65-94f1-29ecb73754ae None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.996163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538807-55ab-4a65-94f1-29ecb73754ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.038543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f5696-e93d-43a7-92ba-4fa4ed623e82 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.061865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28538807-55ab-4a65-94f1-29ecb73754ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.063863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28538807-55ab-4a65-94f1-29ecb73754ae None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.073054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40499b72-ce52-4998-9dc3-b1ecf2af233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.073711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40499b72-ce52-4998-9dc3-b1ecf2af233d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.073997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40499b72-ce52-4998-9dc3-b1ecf2af233d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.074307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40499b72-ce52-4998-9dc3-b1ecf2af233d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.144976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40499b72-ce52-4998-9dc3-b1ecf2af233d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.146471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40499b72-ce52-4998-9dc3-b1ecf2af233d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.165020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 41/86] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:41:57.165866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538807-55ab-4a65-94f1-29ecb73754ae None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.167891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:57.193174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:57.250688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 46/87] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:41:57.251522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40499b72-ce52-4998-9dc3-b1ecf2af233d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.267819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538807-55ab-4a65-94f1-29ecb73754ae None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.303615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89268fb-dc40-415c-b9a1-541b4c200a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.304313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89268fb-dc40-415c-b9a1-541b4c200a74 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.304543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89268fb-dc40-415c-b9a1-541b4c200a74 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.304820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89268fb-dc40-415c-b9a1-541b4c200a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.353810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40499b72-ce52-4998-9dc3-b1ecf2af233d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.372609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89268fb-dc40-415c-b9a1-541b4c200a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.373667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:57.374097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89268fb-dc40-415c-b9a1-541b4c200a74 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.387761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1823c6f-6920-4bec-9d4c-ed9356349fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.388432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1823c6f-6920-4bec-9d4c-ed9356349fb3 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.390716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1823c6f-6920-4bec-9d4c-ed9356349fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.390716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1823c6f-6920-4bec-9d4c-ed9356349fb3 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.390716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1823c6f-6920-4bec-9d4c-ed9356349fb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.391970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1823c6f-6920-4bec-9d4c-ed9356349fb3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.401245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:57.470734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 42/88] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:41:57.471499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89268fb-dc40-415c-b9a1-541b4c200a74 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.487887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 47/89] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:41:57 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:57.488735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1823c6f-6920-4bec-9d4c-ed9356349fb3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.585402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89268fb-dc40-415c-b9a1-541b4c200a74 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.609251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1823c6f-6920-4bec-9d4c-ed9356349fb3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.614216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:57.623437 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d7dd-57d1-4968-ad67-1291f201f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.624363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d7dd-57d1-4968-ad67-1291f201f478 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.624656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d7dd-57d1-4968-ad67-1291f201f478 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.624918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d7dd-57d1-4968-ad67-1291f201f478 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.635824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d7dd-57d1-4968-ad67-1291f201f478 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.635824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d7dd-57d1-4968-ad67-1291f201f478 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.635824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 43/90] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:41:57 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:57.635824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d7dd-57d1-4968-ad67-1291f201f478 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.652301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2acf5e-d39c-4712-a559-0db801932927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.653288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2acf5e-d39c-4712-a559-0db801932927 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.653624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2acf5e-d39c-4712-a559-0db801932927 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.653908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2acf5e-d39c-4712-a559-0db801932927 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.655261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2acf5e-d39c-4712-a559-0db801932927 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.656758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2acf5e-d39c-4712-a559-0db801932927 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.663312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 48/91] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:41:57 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:57.663312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2acf5e-d39c-4712-a559-0db801932927 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.728734 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:57.758403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d7dd-57d1-4968-ad67-1291f201f478 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.804194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2acf5e-d39c-4712-a559-0db801932927 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.804403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5838c-ef04-4165-bb8c-18717d3f81b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.805084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5838c-ef04-4165-bb8c-18717d3f81b7 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.805398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5838c-ef04-4165-bb8c-18717d3f81b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.805765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5838c-ef04-4165-bb8c-18717d3f81b7 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.806981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5838c-ef04-4165-bb8c-18717d3f81b7 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.808485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5838c-ef04-4165-bb8c-18717d3f81b7 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.810202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 44/92] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:41:57 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:57.812284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5838c-ef04-4165-bb8c-18717d3f81b7 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.849568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921ceb-0f4a-4136-8679-5ff9d1891e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.850506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921ceb-0f4a-4136-8679-5ff9d1891e6e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.850788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921ceb-0f4a-4136-8679-5ff9d1891e6e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.851065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921ceb-0f4a-4136-8679-5ff9d1891e6e None admin] PATH_INFO: `/v3/projects/d47600dd186c462390b9e84f29ff8a5d` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.852434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99921ceb-0f4a-4136-8679-5ff9d1891e6e None admin] RBAC: Authorizing `identity:get_project(project_id=d47600dd186c462390b9e84f29ff8a5d)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.853906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99921ceb-0f4a-4136-8679-5ff9d1891e6e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.855895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 49/93] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:41:57 2022] GET /identity/v3/projects/d47600dd186c462390b9e84f29ff8a5d => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:57.856532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921ceb-0f4a-4136-8679-5ff9d1891e6e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.887946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:57.944825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5838c-ef04-4165-bb8c-18717d3f81b7 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.981665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fcf5d-3a42-4d0a-acd7-61869c0f886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.982248 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fcf5d-3a42-4d0a-acd7-61869c0f886b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.982590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fcf5d-3a42-4d0a-acd7-61869c0f886b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.982878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fcf5d-3a42-4d0a-acd7-61869c0f886b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.983749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fcf5d-3a42-4d0a-acd7-61869c0f886b None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=31d62d27680a4a5c899151375f3273a4, user.id=35335aa619474ed5a5f6b04e6a89efaf) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:57.984071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fcf5d-3a42-4d0a-acd7-61869c0f886b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.986189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fcf5d-3a42-4d0a-acd7-61869c0f886b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.992187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921ceb-0f4a-4136-8679-5ff9d1891e6e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.992463 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 45/94] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:41:57 2022] GET /identity/v3/role_assignments?user.id=35335aa619474ed5a5f6b04e6a89efaf&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:57.993287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fcf5d-3a42-4d0a-acd7-61869c0f886b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:58.006897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:58.041333 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b67e8c-1bd4-40c9-b499-9c8c60b2183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:58.042020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b67e8c-1bd4-40c9-b499-9c8c60b2183e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:58.042317 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b67e8c-1bd4-40c9-b499-9c8c60b2183e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:58.047603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b67e8c-1bd4-40c9-b499-9c8c60b2183e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:58.047603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b67e8c-1bd4-40c9-b499-9c8c60b2183e None admin] RBAC: Adding query filter params (role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=31d62d27680a4a5c899151375f3273a4, user.id=f0bc925e5a06416393e984ad52522227) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:58.047603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b67e8c-1bd4-40c9-b499-9c8c60b2183e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:58.047603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b67e8c-1bd4-40c9-b499-9c8c60b2183e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:58.055818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 50/95] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:41:57 2022] GET /identity/v3/role_assignments?user.id=f0bc925e5a06416393e984ad52522227&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:58.059044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b67e8c-1bd4-40c9-b499-9c8c60b2183e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:58.245814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fcf5d-3a42-4d0a-acd7-61869c0f886b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:58.271389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b67e8c-1bd4-40c9-b499-9c8c60b2183e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:58.301553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:58.312549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c027f-38ba-4331-8e8c-453a8aacb362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:58.314261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c027f-38ba-4331-8e8c-453a8aacb362 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:58.314752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c027f-38ba-4331-8e8c-453a8aacb362 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:58.315266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c027f-38ba-4331-8e8c-453a8aacb362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:58.317172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c027f-38ba-4331-8e8c-453a8aacb362 None admin] RBAC: Adding query filter params (role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=31d62d27680a4a5c899151375f3273a4, user.id=f0bc925e5a06416393e984ad52522227) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:58.317722 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c027f-38ba-4331-8e8c-453a8aacb362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:58.319709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c027f-38ba-4331-8e8c-453a8aacb362 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:58.327354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 46/96] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:41:57 2022] GET /identity/v3/role_assignments?user.id=f0bc925e5a06416393e984ad52522227&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:58.341290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053cb9-e63b-4094-979b-9456cb66dbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:58.342731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053cb9-e63b-4094-979b-9456cb66dbe6 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:58.343218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053cb9-e63b-4094-979b-9456cb66dbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:58.343858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053cb9-e63b-4094-979b-9456cb66dbe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:58.345470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053cb9-e63b-4094-979b-9456cb66dbe6 None admin] RBAC: Adding query filter params (role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=d47600dd186c462390b9e84f29ff8a5d, user.id=f0bc925e5a06416393e984ad52522227) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:58.346008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053cb9-e63b-4094-979b-9456cb66dbe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:58.347737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053cb9-e63b-4094-979b-9456cb66dbe6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:58.355477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 51/97] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:41:58 2022] GET /identity/v3/role_assignments?user.id=f0bc925e5a06416393e984ad52522227&scope.project.id=d47600dd186c462390b9e84f29ff8a5d&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:00.405779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041e7ce-f23b-43a1-ab5d-15afa31caeaa None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.406332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041e7ce-f23b-43a1-ab5d-15afa31caeaa None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.406332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041e7ce-f23b-43a1-ab5d-15afa31caeaa None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.408702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 47/98] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:00.414146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e805f7-4f4c-49cf-bdf2-cc3e1df16ab0 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.414635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e805f7-4f4c-49cf-bdf2-cc3e1df16ab0 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.414736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e805f7-4f4c-49cf-bdf2-cc3e1df16ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.440605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c2e805f7-4f4c-49cf-bdf2-cc3e1df16ab0 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:00.441855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c2e805f7-4f4c-49cf-bdf2-cc3e1df16ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:00.481631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:00.514510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2e12a-d915-4167-9a1d-f918e52db343 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.514821 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2e12a-d915-4167-9a1d-f918e52db343 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.515067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2e12a-d915-4167-9a1d-f918e52db343 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.517185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 48/99] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:00.523889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14791e-9a76-41ce-812a-ed5c43e89dae None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.524177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14791e-9a76-41ce-812a-ed5c43e89dae None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.524458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14791e-9a76-41ce-812a-ed5c43e89dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.532088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 52/100] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:00.552616 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-9a14791e-9a76-41ce-812a-ed5c43e89dae None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:00.553833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9a14791e-9a76-41ce-812a-ed5c43e89dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:00.592575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e805f7-4f4c-49cf-bdf2-cc3e1df16ab0 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.631060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 49/101] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:00.659471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14791e-9a76-41ce-812a-ed5c43e89dae None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.774107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14791e-9a76-41ce-812a-ed5c43e89dae None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:00.798502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:00.800996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e805f7-4f4c-49cf-bdf2-cc3e1df16ab0 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:00.813968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6aa6-eeae-4051-aabd-b78d0765e01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:00.815194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6aa6-eeae-4051-aabd-b78d0765e01a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.815506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6aa6-eeae-4051-aabd-b78d0765e01a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.815812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6aa6-eeae-4051-aabd-b78d0765e01a None admin] PATH_INFO: `/v3/domains/default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.817043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad6aa6-eeae-4051-aabd-b78d0765e01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:00.818934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad6aa6-eeae-4051-aabd-b78d0765e01a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:00.820667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 50/102] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:00.826815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6aa6-eeae-4051-aabd-b78d0765e01a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.900322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520379a-4e49-4ded-bb9e-b6102ec82817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:00.901141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520379a-4e49-4ded-bb9e-b6102ec82817 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.901430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520379a-4e49-4ded-bb9e-b6102ec82817 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.901705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520379a-4e49-4ded-bb9e-b6102ec82817 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.924267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520379a-4e49-4ded-bb9e-b6102ec82817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-8520379a-4e49-4ded-bb9e-b6102ec82817 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:00.934575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:00.935445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:00.936266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 53/103] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:00.942739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520379a-4e49-4ded-bb9e-b6102ec82817 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.035038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.036377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6aa6-eeae-4051-aabd-b78d0765e01a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.109022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8047b-ae96-4ed5-a2bc-98c8f475c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.109752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8047b-ae96-4ed5-a2bc-98c8f475c0dc None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.110617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8047b-ae96-4ed5-a2bc-98c8f475c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.110917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8047b-ae96-4ed5-a2bc-98c8f475c0dc None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.111711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8047b-ae96-4ed5-a2bc-98c8f475c0dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:01.113245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8047b-ae96-4ed5-a2bc-98c8f475c0dc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:01.159541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520379a-4e49-4ded-bb9e-b6102ec82817 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.216385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c42ec-5705-4de6-99a3-8d4370eb9a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.217331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c42ec-5705-4de6-99a3-8d4370eb9a72 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.217640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c42ec-5705-4de6-99a3-8d4370eb9a72 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.217947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c42ec-5705-4de6-99a3-8d4370eb9a72 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.218713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c42ec-5705-4de6-99a3-8d4370eb9a72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:01.219024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c42ec-5705-4de6-99a3-8d4370eb9a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:01.221011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c42ec-5705-4de6-99a3-8d4370eb9a72 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:01.230770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 54/104] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:01.236442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c42ec-5705-4de6-99a3-8d4370eb9a72 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.274718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 51/105] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:42:00 2022] POST /identity/v3/projects => generated 302 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:01.323751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232ec31-f224-40e9-8a63-3f41dd66e88c None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.324503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232ec31-f224-40e9-8a63-3f41dd66e88c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.325010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232ec31-f224-40e9-8a63-3f41dd66e88c None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.326938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 52/106] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:01.336370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afc8a9-90f8-4bd9-a200-467bf3fedc6d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.337340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afc8a9-90f8-4bd9-a200-467bf3fedc6d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.338214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afc8a9-90f8-4bd9-a200-467bf3fedc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.346318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.357050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c42ec-5705-4de6-99a3-8d4370eb9a72 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.380716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-82afc8a9-90f8-4bd9-a200-467bf3fedc6d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:01.381954 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-82afc8a9-90f8-4bd9-a200-467bf3fedc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:01.396319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5891a-84ca-46cb-a046-c5510fad9430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.397299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5891a-84ca-46cb-a046-c5510fad9430 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.397644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5891a-84ca-46cb-a046-c5510fad9430 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.397928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5891a-84ca-46cb-a046-c5510fad9430 None admin] PATH_INFO: `/v3/users/039e35725f564be99f6cb2c239a23812` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.420622 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5891a-84ca-46cb-a046-c5510fad9430 None admin] RBAC: Authorizing `identity:get_user(user_id=039e35725f564be99f6cb2c239a23812)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:01.422405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5891a-84ca-46cb-a046-c5510fad9430 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:01.425171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 55/107] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:01 2022] GET /identity/v3/users/039e35725f564be99f6cb2c239a23812 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:01.430995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5891a-84ca-46cb-a046-c5510fad9430 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.524122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.556802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5891a-84ca-46cb-a046-c5510fad9430 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.568771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 53/108] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:01.598520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece42f69-ef4a-4304-9ff5-86859b445c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.599443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece42f69-ef4a-4304-9ff5-86859b445c74 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.599968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece42f69-ef4a-4304-9ff5-86859b445c74 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.600421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece42f69-ef4a-4304-9ff5-86859b445c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.615169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afc8a9-90f8-4bd9-a200-467bf3fedc6d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.623298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.685769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece42f69-ef4a-4304-9ff5-86859b445c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:01.689404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece42f69-ef4a-4304-9ff5-86859b445c74 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:01.804229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afc8a9-90f8-4bd9-a200-467bf3fedc6d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.805498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 56/109] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:42:01.811521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece42f69-ef4a-4304-9ff5-86859b445c74 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.869197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.872417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea2fa7-649f-40cf-ad77-4be49270fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.873266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea2fa7-649f-40cf-ad77-4be49270fce3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.873583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea2fa7-649f-40cf-ad77-4be49270fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.873861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea2fa7-649f-40cf-ad77-4be49270fce3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.895992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea2fa7-649f-40cf-ad77-4be49270fce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-41ea2fa7-649f-40cf-ad77-4be49270fce3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:01.911465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:01.912656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:01.913465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 54/110] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:01.914486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312420-b070-4ee2-ac19-496046733f0f None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.914733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312420-b070-4ee2-ac19-496046733f0f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.915078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312420-b070-4ee2-ac19-496046733f0f None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.916319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 55/111] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:01.920795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312420-b070-4ee2-ac19-496046733f0f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.926425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece42f69-ef4a-4304-9ff5-86859b445c74 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.959861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.972849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a905d-3f65-4181-878d-425517e32b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.974166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a905d-3f65-4181-878d-425517e32b62 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.974613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a905d-3f65-4181-878d-425517e32b62 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.975514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a905d-3f65-4181-878d-425517e32b62 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.977843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a905d-3f65-4181-878d-425517e32b62 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:01.980568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a905d-3f65-4181-878d-425517e32b62 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:01.983036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 57/112] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:01 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:01.985373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e583-bbcf-4c83-bb1d-2b8502a1f546 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.985891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e583-bbcf-4c83-bb1d-2b8502a1f546 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.986315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e583-bbcf-4c83-bb1d-2b8502a1f546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.011086 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-7bb3e583-bbcf-4c83-bb1d-2b8502a1f546 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:02.013099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7bb3e583-bbcf-4c83-bb1d-2b8502a1f546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:02.052260 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312420-b070-4ee2-ac19-496046733f0f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.092337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaff00-f79e-4bc5-bf56-514eaab46d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.093019 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaff00-f79e-4bc5-bf56-514eaab46d76 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.093387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaff00-f79e-4bc5-bf56-514eaab46d76 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.093781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaff00-f79e-4bc5-bf56-514eaab46d76 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.094586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaff00-f79e-4bc5-bf56-514eaab46d76 None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:02.094966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaff00-f79e-4bc5-bf56-514eaab46d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:02.096525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaff00-f79e-4bc5-bf56-514eaab46d76 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:02.103057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 58/113] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:02.104849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdbdbc-0698-4cef-9b06-0980dc3a2d64 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.105376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdbdbc-0698-4cef-9b06-0980dc3a2d64 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.105832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdbdbc-0698-4cef-9b06-0980dc3a2d64 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.106503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 56/114] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:02.111717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaff00-f79e-4bc5-bf56-514eaab46d76 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.112661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 59/115] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:02.113558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdbdbc-0698-4cef-9b06-0980dc3a2d64 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.172835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:02.217055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:02.225875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaff00-f79e-4bc5-bf56-514eaab46d76 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.231162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdbdbc-0698-4cef-9b06-0980dc3a2d64 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.266158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d80263-cd9d-4fda-ac85-1940db967207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.267226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d80263-cd9d-4fda-ac85-1940db967207 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.267506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d80263-cd9d-4fda-ac85-1940db967207 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.267816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d80263-cd9d-4fda-ac85-1940db967207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.268652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d80263-cd9d-4fda-ac85-1940db967207 None admin] RBAC: Adding query filter params (role.id=30fcc9db6fb54018807b35bc5f6ff66f, scope.project.id=31d62d27680a4a5c899151375f3273a4, user.id=039e35725f564be99f6cb2c239a23812) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:02.268965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d80263-cd9d-4fda-ac85-1940db967207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:02.269967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebad3f-09a3-44be-b94a-b862995163c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.270414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d80263-cd9d-4fda-ac85-1940db967207 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:02.270846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebad3f-09a3-44be-b94a-b862995163c8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.271134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebad3f-09a3-44be-b94a-b862995163c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.271414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebad3f-09a3-44be-b94a-b862995163c8 None admin] PATH_INFO: `/v3/users/f0bc925e5a06416393e984ad52522227` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.272876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebad3f-09a3-44be-b94a-b862995163c8 None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc925e5a06416393e984ad52522227)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:02.274524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebad3f-09a3-44be-b94a-b862995163c8 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:02.284030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 60/116] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:02 2022] GET /identity/v3/users/f0bc925e5a06416393e984ad52522227 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:02.284218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 57/117] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:02 2022] GET /identity/v3/role_assignments?user.id=039e35725f564be99f6cb2c239a23812&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=30fcc9db6fb54018807b35bc5f6ff66f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:02.284391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502e1d-3690-4b30-b6fc-41f309975a48 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.284464 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d80263-cd9d-4fda-ac85-1940db967207 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.284530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502e1d-3690-4b30-b6fc-41f309975a48 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.284530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502e1d-3690-4b30-b6fc-41f309975a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.301720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d4502e1d-3690-4b30-b6fc-41f309975a48 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:02.303072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d4502e1d-3690-4b30-b6fc-41f309975a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:02.412778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d80263-cd9d-4fda-ac85-1940db967207 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.415739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 61/118] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:02.417374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4485e9-ae1a-4a8e-a2be-fcf0ba71634b None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.417662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4485e9-ae1a-4a8e-a2be-fcf0ba71634b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.417937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4485e9-ae1a-4a8e-a2be-fcf0ba71634b None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.425426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 62/119] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:02.430278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4485e9-ae1a-4a8e-a2be-fcf0ba71634b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.480837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180d6c2-0be5-4d8b-ae96-28ed2c4b5641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.482505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d6c2-0be5-4d8b-ae96-28ed2c4b5641 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.482505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d6c2-0be5-4d8b-ae96-28ed2c4b5641 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.482505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d6c2-0be5-4d8b-ae96-28ed2c4b5641 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.494497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:02.499349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180d6c2-0be5-4d8b-ae96-28ed2c4b5641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-b180d6c2-0be5-4d8b-ae96-28ed2c4b5641 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:02.507920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:02.511128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 58/120] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:02.511996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889d15-4e94-4596-878d-bc71239ed02b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.512987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889d15-4e94-4596-878d-bc71239ed02b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.512987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889d15-4e94-4596-878d-bc71239ed02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.529404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ee889d15-4e94-4596-878d-bc71239ed02b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:02.530757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ee889d15-4e94-4596-878d-bc71239ed02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:02.543188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:02.566225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4485e9-ae1a-4a8e-a2be-fcf0ba71634b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.606937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed27aa-8a1d-47b4-9c14-b94947ec02d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.609446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed27aa-8a1d-47b4-9c14-b94947ec02d2 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.610661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed27aa-8a1d-47b4-9c14-b94947ec02d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.611096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 59/121] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:02.611505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed27aa-8a1d-47b4-9c14-b94947ec02d2 None admin] PATH_INFO: `/v3/projects/d47600dd186c462390b9e84f29ff8a5d` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.612118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee889d15-4e94-4596-878d-bc71239ed02b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.613281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed27aa-8a1d-47b4-9c14-b94947ec02d2 None admin] RBAC: Authorizing `identity:get_project(project_id=d47600dd186c462390b9e84f29ff8a5d)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:02.615129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed27aa-8a1d-47b4-9c14-b94947ec02d2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:02.617230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 63/122] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:02 2022] GET /identity/v3/projects/d47600dd186c462390b9e84f29ff8a5d => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:02.618330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed27aa-8a1d-47b4-9c14-b94947ec02d2 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.731146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed27aa-8a1d-47b4-9c14-b94947ec02d2 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.734588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee889d15-4e94-4596-878d-bc71239ed02b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.746988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:02.768149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79757198-6664-4797-bd59-391545411417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.768968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757198-6664-4797-bd59-391545411417 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.769397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757198-6664-4797-bd59-391545411417 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.769782 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757198-6664-4797-bd59-391545411417 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.770688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79757198-6664-4797-bd59-391545411417 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:02.771097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79757198-6664-4797-bd59-391545411417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:02.772993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79757198-6664-4797-bd59-391545411417 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:02.774550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cb6db-7116-4b57-85d7-0360c0d7dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.775532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cb6db-7116-4b57-85d7-0360c0d7dad7 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.776015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cb6db-7116-4b57-85d7-0360c0d7dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.776456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cb6db-7116-4b57-85d7-0360c0d7dad7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.783511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 64/123] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:02.784493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79757198-6664-4797-bd59-391545411417 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.790163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cb6db-7116-4b57-85d7-0360c0d7dad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-ff7cb6db-7116-4b57-85d7-0360c0d7dad7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:02.799969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:02.801048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:02.802015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:02.804360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 60/124] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:02.809958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cb6db-7116-4b57-85d7-0360c0d7dad7 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.821177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:02.897441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79757198-6664-4797-bd59-391545411417 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.930032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cb6db-7116-4b57-85d7-0360c0d7dad7 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.934345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ef5ba-b48e-477d-a1bb-943a1cc7d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.935350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef5ba-b48e-477d-a1bb-943a1cc7d1ac None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.935769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef5ba-b48e-477d-a1bb-943a1cc7d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.936203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef5ba-b48e-477d-a1bb-943a1cc7d1ac None admin] PATH_INFO: `/v3/projects/d47600dd186c462390b9e84f29ff8a5d/users/f0bc925e5a06416393e984ad52522227/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.938503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ef5ba-b48e-477d-a1bb-943a1cc7d1ac None admin] RBAC: Authorizing `identity:create_grant(project_id=d47600dd186c462390b9e84f29ff8a5d, user_id=f0bc925e5a06416393e984ad52522227, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:02.940135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ef5ba-b48e-477d-a1bb-943a1cc7d1ac None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:02.970141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a57e46-5930-460a-98f4-a02a29d45bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.971179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57e46-5930-460a-98f4-a02a29d45bf1 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.971649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57e46-5930-460a-98f4-a02a29d45bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.972087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57e46-5930-460a-98f4-a02a29d45bf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.983548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a57e46-5930-460a-98f4-a02a29d45bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-74a57e46-5930-460a-98f4-a02a29d45bf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:02.991846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:02.992826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:02.993635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:02.994238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 61/125] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:42:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:02.994786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a57e46-5930-460a-98f4-a02a29d45bf1 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:03.065731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:03.080485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 65/126] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:42:02 2022] PUT /identity/v3/projects/d47600dd186c462390b9e84f29ff8a5d/users/f0bc925e5a06416393e984ad52522227/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:03.082155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ef5ba-b48e-477d-a1bb-943a1cc7d1ac None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:03.135475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a57e46-5930-460a-98f4-a02a29d45bf1 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:03.164855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:03.210224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bf490-af9b-48c4-b2ae-03eb61aa4c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:03.213361 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf490-af9b-48c4-b2ae-03eb61aa4c1f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.213655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf490-af9b-48c4-b2ae-03eb61aa4c1f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.213940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf490-af9b-48c4-b2ae-03eb61aa4c1f None admin] PATH_INFO: `/v3/users/f0bc925e5a06416393e984ad52522227` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.217136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf490-af9b-48c4-b2ae-03eb61aa4c1f None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc925e5a06416393e984ad52522227)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:03.218912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf490-af9b-48c4-b2ae-03eb61aa4c1f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:03.220666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 62/127] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:02 2022] GET /identity/v3/users/f0bc925e5a06416393e984ad52522227 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:03.221412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bf490-af9b-48c4-b2ae-03eb61aa4c1f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:03.308598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ef5ba-b48e-477d-a1bb-943a1cc7d1ac None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:03.359680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c432-09ee-427f-be78-0dd37d7abb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:03.360371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c432-09ee-427f-be78-0dd37d7abb1a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.360663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c432-09ee-427f-be78-0dd37d7abb1a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.360946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c432-09ee-427f-be78-0dd37d7abb1a None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.361760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529c432-09ee-427f-be78-0dd37d7abb1a None admin] RBAC: Adding query filter params (name=member) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:03.362085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529c432-09ee-427f-be78-0dd37d7abb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:03.363477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529c432-09ee-427f-be78-0dd37d7abb1a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:03.373595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 66/128] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:03.374423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c432-09ee-427f-be78-0dd37d7abb1a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:03.402812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bf490-af9b-48c4-b2ae-03eb61aa4c1f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:03.442756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f951f6-ab5c-4258-b258-077bf49f5ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:03.443546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f951f6-ab5c-4258-b258-077bf49f5ed3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.443870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f951f6-ab5c-4258-b258-077bf49f5ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.444156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f951f6-ab5c-4258-b258-077bf49f5ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.444916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f951f6-ab5c-4258-b258-077bf49f5ed3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:03.445230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f951f6-ab5c-4258-b258-077bf49f5ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:03.446641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f951f6-ab5c-4258-b258-077bf49f5ed3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:03.448319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:03.457398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 63/129] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:03.461414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f951f6-ab5c-4258-b258-077bf49f5ed3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:03.551155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:03.559542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c432-09ee-427f-be78-0dd37d7abb1a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:03.574264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f951f6-ab5c-4258-b258-077bf49f5ed3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:03.610389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383fa5-4b78-4d79-b2b2-0824e059190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:03.611496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383fa5-4b78-4d79-b2b2-0824e059190d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.611913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383fa5-4b78-4d79-b2b2-0824e059190d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.612589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383fa5-4b78-4d79-b2b2-0824e059190d None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.614159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d383fa5-4b78-4d79-b2b2-0824e059190d None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:03.614892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b362cb7-45bc-4101-8fed-1f803278ce6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:03.615958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b362cb7-45bc-4101-8fed-1f803278ce6a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.616404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b362cb7-45bc-4101-8fed-1f803278ce6a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.616521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d383fa5-4b78-4d79-b2b2-0824e059190d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:03.616935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b362cb7-45bc-4101-8fed-1f803278ce6a None admin] PATH_INFO: `/v3/users/f0bc925e5a06416393e984ad52522227` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.618342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b362cb7-45bc-4101-8fed-1f803278ce6a None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc925e5a06416393e984ad52522227)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:03.618631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 67/130] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:03 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:03.619717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383fa5-4b78-4d79-b2b2-0824e059190d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:03.620442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b362cb7-45bc-4101-8fed-1f803278ce6a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:03.622679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 64/131] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:03 2022] GET /identity/v3/users/f0bc925e5a06416393e984ad52522227 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:03.627325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b362cb7-45bc-4101-8fed-1f803278ce6a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:03.774141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:03.819685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383fa5-4b78-4d79-b2b2-0824e059190d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:03.867614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b362cb7-45bc-4101-8fed-1f803278ce6a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:03.868662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bddb6-6772-433c-a14d-d0e6c8cd0a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:03.869781 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bddb6-6772-433c-a14d-d0e6c8cd0a05 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.870237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bddb6-6772-433c-a14d-d0e6c8cd0a05 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.871194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bddb6-6772-433c-a14d-d0e6c8cd0a05 None admin] PATH_INFO: `/v3/users/35335aa619474ed5a5f6b04e6a89efaf` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.874080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bddb6-6772-433c-a14d-d0e6c8cd0a05 None admin] RBAC: Authorizing `identity:get_user(user_id=35335aa619474ed5a5f6b04e6a89efaf)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:03.877404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bddb6-6772-433c-a14d-d0e6c8cd0a05 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:03.885495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 68/132] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:03 2022] GET /identity/v3/users/35335aa619474ed5a5f6b04e6a89efaf => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:03.886692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bddb6-6772-433c-a14d-d0e6c8cd0a05 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:03.937256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:03.938946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158cce7-3ab4-4ad6-9ba8-65b3b4be8768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:03.940078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158cce7-3ab4-4ad6-9ba8-65b3b4be8768 None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.940523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158cce7-3ab4-4ad6-9ba8-65b3b4be8768 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.940999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158cce7-3ab4-4ad6-9ba8-65b3b4be8768 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4/users/f0bc925e5a06416393e984ad52522227/roles/0c702df8791a47cb89a43521d61e4f21` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.949460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158cce7-3ab4-4ad6-9ba8-65b3b4be8768 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d62d27680a4a5c899151375f3273a4, user_id=f0bc925e5a06416393e984ad52522227, role_id=0c702df8791a47cb89a43521d61e4f21)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:03.951178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158cce7-3ab4-4ad6-9ba8-65b3b4be8768 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.007634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bddb6-6772-433c-a14d-d0e6c8cd0a05 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.042511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9544-4c4e-47b1-a5a1-0e2c4e108d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.043373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9544-4c4e-47b1-a5a1-0e2c4e108d9b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.043684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9544-4c4e-47b1-a5a1-0e2c4e108d9b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.043968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9544-4c4e-47b1-a5a1-0e2c4e108d9b None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.045252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f9544-4c4e-47b1-a5a1-0e2c4e108d9b None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.046747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f9544-4c4e-47b1-a5a1-0e2c4e108d9b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.049169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 69/133] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:03 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:04.049771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9544-4c4e-47b1-a5a1-0e2c4e108d9b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.118286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 65/134] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:42:03 2022] PUT /identity/v3/projects/31d62d27680a4a5c899151375f3273a4/users/f0bc925e5a06416393e984ad52522227/roles/0c702df8791a47cb89a43521d61e4f21 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:04.119018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158cce7-3ab4-4ad6-9ba8-65b3b4be8768 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.171863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9544-4c4e-47b1-a5a1-0e2c4e108d9b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.174500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:04.216321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1872a-1142-497d-b829-de6f6f243998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.217772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1872a-1142-497d-b829-de6f6f243998 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.218062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1872a-1142-497d-b829-de6f6f243998 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.218342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1872a-1142-497d-b829-de6f6f243998 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.220271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1872a-1142-497d-b829-de6f6f243998 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.222408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1872a-1142-497d-b829-de6f6f243998 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.230198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 70/135] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:04 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:04.232050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd11547-bdc1-4916-b833-a81bfb9baad8 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.232354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd11547-bdc1-4916-b833-a81bfb9baad8 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.232984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd11547-bdc1-4916-b833-a81bfb9baad8 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.235944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 71/136] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:04.236916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd11547-bdc1-4916-b833-a81bfb9baad8 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.370191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd11547-bdc1-4916-b833-a81bfb9baad8 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.413541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff69c2-b9ad-4790-bf9a-ef457f2131e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.415072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff69c2-b9ad-4790-bf9a-ef457f2131e7 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.415360 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff69c2-b9ad-4790-bf9a-ef457f2131e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.415667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff69c2-b9ad-4790-bf9a-ef457f2131e7 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4/users/35335aa619474ed5a5f6b04e6a89efaf/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.418199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff69c2-b9ad-4790-bf9a-ef457f2131e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d62d27680a4a5c899151375f3273a4, user_id=35335aa619474ed5a5f6b04e6a89efaf, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.420443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff69c2-b9ad-4790-bf9a-ef457f2131e7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.444567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158cce7-3ab4-4ad6-9ba8-65b3b4be8768 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.476520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:04.489028 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93535085-d50b-4b1b-98c8-85f98c60d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.490006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93535085-d50b-4b1b-98c8-85f98c60d463 None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.490289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93535085-d50b-4b1b-98c8-85f98c60d463 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.490565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93535085-d50b-4b1b-98c8-85f98c60d463 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4/users/f0bc925e5a06416393e984ad52522227/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.492600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93535085-d50b-4b1b-98c8-85f98c60d463 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d62d27680a4a5c899151375f3273a4, user_id=f0bc925e5a06416393e984ad52522227, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.494088 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93535085-d50b-4b1b-98c8-85f98c60d463 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.506169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 72/137] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:42:04 2022] PUT /identity/v3/projects/31d62d27680a4a5c899151375f3273a4/users/35335aa619474ed5a5f6b04e6a89efaf/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:04.509010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235b86-fe39-405f-ab51-7b26139415f4 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.509010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235b86-fe39-405f-ab51-7b26139415f4 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.509010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235b86-fe39-405f-ab51-7b26139415f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.528554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1a235b86-fe39-405f-ab51-7b26139415f4 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:04.529920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1a235b86-fe39-405f-ab51-7b26139415f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:04.560451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:04.622568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 73/138] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:04.649236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a235b86-fe39-405f-ab51-7b26139415f4 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.682538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 66/139] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:42:04 2022] PUT /identity/v3/projects/31d62d27680a4a5c899151375f3273a4/users/f0bc925e5a06416393e984ad52522227/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:04.788162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a235b86-fe39-405f-ab51-7b26139415f4 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.832874 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140464b1-1845-42b1-9df3-41ff19bd8e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.833982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140464b1-1845-42b1-9df3-41ff19bd8e04 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.834413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140464b1-1845-42b1-9df3-41ff19bd8e04 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.834850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140464b1-1845-42b1-9df3-41ff19bd8e04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.836412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140464b1-1845-42b1-9df3-41ff19bd8e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.838137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140464b1-1845-42b1-9df3-41ff19bd8e04 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.840002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 74/140] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:04.847058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93535085-d50b-4b1b-98c8-85f98c60d463 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.997150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93535085-d50b-4b1b-98c8-85f98c60d463 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.034732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713940a-10f6-4bc7-b952-a564b64e93d3 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.035358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713940a-10f6-4bc7-b952-a564b64e93d3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.035981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713940a-10f6-4bc7-b952-a564b64e93d3 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.037813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 75/141] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:05.042529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57ce9-9f34-47a0-b428-19c53c2aa380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.042529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57ce9-9f34-47a0-b428-19c53c2aa380 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.042529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57ce9-9f34-47a0-b428-19c53c2aa380 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.042529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57ce9-9f34-47a0-b428-19c53c2aa380 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.042857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57ce9-9f34-47a0-b428-19c53c2aa380 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.043880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57ce9-9f34-47a0-b428-19c53c2aa380 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.044657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba31f6b-de11-48c9-91f3-3d64a359efdc None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.045220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba31f6b-de11-48c9-91f3-3d64a359efdc None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.045683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba31f6b-de11-48c9-91f3-3d64a359efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.069727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-0ba31f6b-de11-48c9-91f3-3d64a359efdc None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:05.074435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-0ba31f6b-de11-48c9-91f3-3d64a359efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:05.099867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:05.165942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 76/142] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:05.184790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 67/143] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:04 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:05.210122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba31f6b-de11-48c9-91f3-3d64a359efdc None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.362495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba31f6b-de11-48c9-91f3-3d64a359efdc None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.410050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbad4d-1b10-41ca-b3f0-8f9b181b4878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.410862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbad4d-1b10-41ca-b3f0-8f9b181b4878 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.411142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbad4d-1b10-41ca-b3f0-8f9b181b4878 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.411416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbad4d-1b10-41ca-b3f0-8f9b181b4878 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.426649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbad4d-1b10-41ca-b3f0-8f9b181b4878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-37fbad4d-1b10-41ca-b3f0-8f9b181b4878 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:05.434590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:05.435535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:05.436385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 77/144] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:05.441879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57ce9-9f34-47a0-b428-19c53c2aa380 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.487006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:05.549844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57ce9-9f34-47a0-b428-19c53c2aa380 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.597577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e3587-d70b-4e48-a629-cd38a5394fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.598294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e3587-d70b-4e48-a629-cd38a5394fc9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.598651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e3587-d70b-4e48-a629-cd38a5394fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.598933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e3587-d70b-4e48-a629-cd38a5394fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.599738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e3587-d70b-4e48-a629-cd38a5394fc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:05.600050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e3587-d70b-4e48-a629-cd38a5394fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.601513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e3587-d70b-4e48-a629-cd38a5394fc9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.614772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 68/145] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:05.620517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbad4d-1b10-41ca-b3f0-8f9b181b4878 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.657359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:05.750950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbad4d-1b10-41ca-b3f0-8f9b181b4878 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.790991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c28b3-d693-4707-942d-919da43ceeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.792319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c28b3-d693-4707-942d-919da43ceeb5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.792834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c28b3-d693-4707-942d-919da43ceeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.793305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c28b3-d693-4707-942d-919da43ceeb5 None admin] PATH_INFO: `/v3/users/039e35725f564be99f6cb2c239a23812` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.794708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c28b3-d693-4707-942d-919da43ceeb5 None admin] RBAC: Authorizing `identity:get_user(user_id=039e35725f564be99f6cb2c239a23812)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.796473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c28b3-d693-4707-942d-919da43ceeb5 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.799130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 78/146] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:05 2022] GET /identity/v3/users/039e35725f564be99f6cb2c239a23812 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:05.804270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e3587-d70b-4e48-a629-cd38a5394fc9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.939137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e3587-d70b-4e48-a629-cd38a5394fc9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.940973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:05.982955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e1578-5be8-4e43-a980-9c8a74441124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.984010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e1578-5be8-4e43-a980-9c8a74441124 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.985029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e1578-5be8-4e43-a980-9c8a74441124 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.987540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e1578-5be8-4e43-a980-9c8a74441124 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.988935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e1578-5be8-4e43-a980-9c8a74441124 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.990483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e1578-5be8-4e43-a980-9c8a74441124 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.992340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 69/147] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:05 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:05.998109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c28b3-d693-4707-942d-919da43ceeb5 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:06.108339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:06.124712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c28b3-d693-4707-942d-919da43ceeb5 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:06.161524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54b484-96b8-4788-8cca-5fe84e779817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:06.162425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54b484-96b8-4788-8cca-5fe84e779817 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:06.162704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54b484-96b8-4788-8cca-5fe84e779817 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:06.162974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54b484-96b8-4788-8cca-5fe84e779817 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4/users/039e35725f564be99f6cb2c239a23812/roles/30fcc9db6fb54018807b35bc5f6ff66f` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:06.165052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54b484-96b8-4788-8cca-5fe84e779817 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d62d27680a4a5c899151375f3273a4, user_id=039e35725f564be99f6cb2c239a23812, role_id=30fcc9db6fb54018807b35bc5f6ff66f)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:06.166563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54b484-96b8-4788-8cca-5fe84e779817 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:06.178230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e51c-5569-451f-86c4-d5a9b938c97f None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:06.178664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e51c-5569-451f-86c4-d5a9b938c97f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:06.178937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e51c-5569-451f-86c4-d5a9b938c97f None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:06.182359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 70/148] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:06.190722 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2e41-e541-4022-b75d-6ad89e13884e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:06.190986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2e41-e541-4022-b75d-6ad89e13884e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:06.191603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2e41-e541-4022-b75d-6ad89e13884e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:06.210747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a22c2e41-e541-4022-b75d-6ad89e13884e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:06.211981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a22c2e41-e541-4022-b75d-6ad89e13884e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:06.293995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 71/149] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:06.303291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 79/150] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:42:05 2022] PUT /identity/v3/projects/31d62d27680a4a5c899151375f3273a4/users/039e35725f564be99f6cb2c239a23812/roles/30fcc9db6fb54018807b35bc5f6ff66f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:06.322558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2e41-e541-4022-b75d-6ad89e13884e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:06.449495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:06.453892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2e41-e541-4022-b75d-6ad89e13884e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:06.495035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bda58c-d3df-4b68-ad86-1795220c9f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:06.495925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bda58c-d3df-4b68-ad86-1795220c9f09 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:06.496215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bda58c-d3df-4b68-ad86-1795220c9f09 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:06.496496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bda58c-d3df-4b68-ad86-1795220c9f09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:06.510848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bda58c-d3df-4b68-ad86-1795220c9f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-66bda58c-d3df-4b68-ad86-1795220c9f09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:06.518689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:06.519556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:06.520377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 72/151] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:06.528574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54b484-96b8-4788-8cca-5fe84e779817 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:06.668895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54b484-96b8-4788-8cca-5fe84e779817 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:06.731664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc0e2-4c0a-441b-9cd5-d13986b25570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:06.732266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc0e2-4c0a-441b-9cd5-d13986b25570 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:06.732547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc0e2-4c0a-441b-9cd5-d13986b25570 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:06.732822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc0e2-4c0a-441b-9cd5-d13986b25570 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:06.733581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc0e2-4c0a-441b-9cd5-d13986b25570 None admin] RBAC: Adding query filter params (name=member) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:06.733884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc0e2-4c0a-441b-9cd5-d13986b25570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:06.738135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc0e2-4c0a-441b-9cd5-d13986b25570 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:06.749853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 80/152] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:06.756904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bda58c-d3df-4b68-ad86-1795220c9f09 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:06.890977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bda58c-d3df-4b68-ad86-1795220c9f09 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:06.935227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d14332-2ff1-467e-b8e6-39d9081d1492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:06.936144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d14332-2ff1-467e-b8e6-39d9081d1492 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:06.936435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d14332-2ff1-467e-b8e6-39d9081d1492 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:06.936728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d14332-2ff1-467e-b8e6-39d9081d1492 None admin] PATH_INFO: `/v3/users/f0bc925e5a06416393e984ad52522227` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:06.938047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d14332-2ff1-467e-b8e6-39d9081d1492 None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc925e5a06416393e984ad52522227)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:06.939535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d14332-2ff1-467e-b8e6-39d9081d1492 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:06.941261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 73/153] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:06 2022] GET /identity/v3/users/f0bc925e5a06416393e984ad52522227 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:06.947086 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc0e2-4c0a-441b-9cd5-d13986b25570 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:06.968600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:07.088620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc0e2-4c0a-441b-9cd5-d13986b25570 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:07.132822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fc8c8-8eec-47b5-b255-1dabc77d5fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:07.133494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fc8c8-8eec-47b5-b255-1dabc77d5fea None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:07.133774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fc8c8-8eec-47b5-b255-1dabc77d5fea None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:07.134045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fc8c8-8eec-47b5-b255-1dabc77d5fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:07.210829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fc8c8-8eec-47b5-b255-1dabc77d5fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:07.212482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fc8c8-8eec-47b5-b255-1dabc77d5fea None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:07.232332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:07.336371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 81/154] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:07.342672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d14332-2ff1-467e-b8e6-39d9081d1492 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:07.393113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:07.482205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d14332-2ff1-467e-b8e6-39d9081d1492 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:07.523206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bd848-b731-4789-a04e-6f1cc9b041f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:07.524110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bd848-b731-4789-a04e-6f1cc9b041f8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:07.524399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bd848-b731-4789-a04e-6f1cc9b041f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:07.524676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bd848-b731-4789-a04e-6f1cc9b041f8 None admin] PATH_INFO: `/v3/projects/d47600dd186c462390b9e84f29ff8a5d` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:07.525904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bd848-b731-4789-a04e-6f1cc9b041f8 None admin] RBAC: Authorizing `identity:get_project(project_id=d47600dd186c462390b9e84f29ff8a5d)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:07.527393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bd848-b731-4789-a04e-6f1cc9b041f8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:07.529197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 74/155] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:07 2022] GET /identity/v3/projects/d47600dd186c462390b9e84f29ff8a5d => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:07.540847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fc8c8-8eec-47b5-b255-1dabc77d5fea None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:07.686613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fc8c8-8eec-47b5-b255-1dabc77d5fea None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:07.703921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:07.737741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c7994-db20-4bbd-ae54-9a25edbf7d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:07.738338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c7994-db20-4bbd-ae54-9a25edbf7d33 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:07.738619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c7994-db20-4bbd-ae54-9a25edbf7d33 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:07.738894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c7994-db20-4bbd-ae54-9a25edbf7d33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:07.739760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c7994-db20-4bbd-ae54-9a25edbf7d33 None admin] RBAC: Adding query filter params (role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=d47600dd186c462390b9e84f29ff8a5d, user.id=f0bc925e5a06416393e984ad52522227) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:07.740096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c7994-db20-4bbd-ae54-9a25edbf7d33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:07.741558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c7994-db20-4bbd-ae54-9a25edbf7d33 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:07.747830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 82/156] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:07 2022] GET /identity/v3/role_assignments?user.id=f0bc925e5a06416393e984ad52522227&scope.project.id=d47600dd186c462390b9e84f29ff8a5d&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:08.089457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8516-459c-4ccc-a939-5bdc4fc551b6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.089990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8516-459c-4ccc-a939-5bdc4fc551b6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.089990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8516-459c-4ccc-a939-5bdc4fc551b6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.091393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 75/157] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:08.111032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6182a-2f7e-42c8-a41a-d1477a9ad704 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.111336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6182a-2f7e-42c8-a41a-d1477a9ad704 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.111613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6182a-2f7e-42c8-a41a-d1477a9ad704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.128925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-13c6182a-2f7e-42c8-a41a-d1477a9ad704 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:08.135535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-13c6182a-2f7e-42c8-a41a-d1477a9ad704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:08.208081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 83/158] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:08.232981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a8516-459c-4ccc-a939-5bdc4fc551b6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.342471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:08.350265 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a8516-459c-4ccc-a939-5bdc4fc551b6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.368301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dfc8d-5433-4adc-a1ea-87457bb027d0 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.368963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dfc8d-5433-4adc-a1ea-87457bb027d0 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.369435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dfc8d-5433-4adc-a1ea-87457bb027d0 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.371254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 84/159] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:08.378566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e16d-3334-4ef8-bd04-3860c437df81 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.379495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e16d-3334-4ef8-bd04-3860c437df81 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.380260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e16d-3334-4ef8-bd04-3860c437df81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.391604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456d1bd-ad88-4c8b-94e5-d4b5c6b47315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.392377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456d1bd-ad88-4c8b-94e5-d4b5c6b47315 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.393053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456d1bd-ad88-4c8b-94e5-d4b5c6b47315 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.393673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456d1bd-ad88-4c8b-94e5-d4b5c6b47315 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.416951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-def8e16d-3334-4ef8-bd04-3860c437df81 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:08.418482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-def8e16d-3334-4ef8-bd04-3860c437df81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:08.419682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456d1bd-ad88-4c8b-94e5-d4b5c6b47315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-1456d1bd-ad88-4c8b-94e5-d4b5c6b47315 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:08.434545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:08.435704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:08.436678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:08.448885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 76/160] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:08.457573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456d1bd-ad88-4c8b-94e5-d4b5c6b47315 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.583855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 85/161] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:08.637484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456d1bd-ad88-4c8b-94e5-d4b5c6b47315 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.651834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8e16d-3334-4ef8-bd04-3860c437df81 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.703989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:08.713059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241d00-4995-4b5e-867a-ecf196758a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.713909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241d00-4995-4b5e-867a-ecf196758a45 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.714295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241d00-4995-4b5e-867a-ecf196758a45 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.714671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241d00-4995-4b5e-867a-ecf196758a45 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.715603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241d00-4995-4b5e-867a-ecf196758a45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:08.716097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241d00-4995-4b5e-867a-ecf196758a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:08.717875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241d00-4995-4b5e-867a-ecf196758a45 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:08.733557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 77/162] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:08.739790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241d00-4995-4b5e-867a-ecf196758a45 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.779745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:08.806662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8e16d-3334-4ef8-bd04-3860c437df81 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.864918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa468eb-113b-4e7b-bb25-19c0143fb0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.865732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa468eb-113b-4e7b-bb25-19c0143fb0d3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.866010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa468eb-113b-4e7b-bb25-19c0143fb0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.866279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa468eb-113b-4e7b-bb25-19c0143fb0d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.889424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa468eb-113b-4e7b-bb25-19c0143fb0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-7aa468eb-113b-4e7b-bb25-19c0143fb0d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:08.901467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:08.902464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:08.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 86/163] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:42:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:08.916756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa468eb-113b-4e7b-bb25-19c0143fb0d3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.965967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241d00-4995-4b5e-867a-ecf196758a45 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.037395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec505fe4-c1cb-4db7-b953-64897c7f0b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.038277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec505fe4-c1cb-4db7-b953-64897c7f0b4e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.043943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec505fe4-c1cb-4db7-b953-64897c7f0b4e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.044233 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec505fe4-c1cb-4db7-b953-64897c7f0b4e None admin] PATH_INFO: `/v3/users/f0bc925e5a06416393e984ad52522227` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.045550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec505fe4-c1cb-4db7-b953-64897c7f0b4e None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc925e5a06416393e984ad52522227)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.047635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec505fe4-c1cb-4db7-b953-64897c7f0b4e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.049283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 78/164] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:08 2022] GET /identity/v3/users/f0bc925e5a06416393e984ad52522227 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:09.057048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec505fe4-c1cb-4db7-b953-64897c7f0b4e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.060481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:09.076894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa468eb-113b-4e7b-bb25-19c0143fb0d3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.168436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac3045-e132-4227-95c6-a3991362682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.169039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac3045-e132-4227-95c6-a3991362682b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.169349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac3045-e132-4227-95c6-a3991362682b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.169623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac3045-e132-4227-95c6-a3991362682b None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.170406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac3045-e132-4227-95c6-a3991362682b None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:09.170712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac3045-e132-4227-95c6-a3991362682b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.172812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac3045-e132-4227-95c6-a3991362682b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.189844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 87/165] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:09.193333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:09.200599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac3045-e132-4227-95c6-a3991362682b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.206716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec505fe4-c1cb-4db7-b953-64897c7f0b4e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.256645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16412f3-475b-4c89-8f1c-77ea729ca196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.257297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16412f3-475b-4c89-8f1c-77ea729ca196 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.257581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16412f3-475b-4c89-8f1c-77ea729ca196 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.257854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16412f3-475b-4c89-8f1c-77ea729ca196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.365352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16412f3-475b-4c89-8f1c-77ea729ca196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.373011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16412f3-475b-4c89-8f1c-77ea729ca196 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.414420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac3045-e132-4227-95c6-a3991362682b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.485676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f9533-5f01-4abe-884e-719c5ccb36dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.486576 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f9533-5f01-4abe-884e-719c5ccb36dd None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.486856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f9533-5f01-4abe-884e-719c5ccb36dd None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.487131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f9533-5f01-4abe-884e-719c5ccb36dd None admin] PATH_INFO: `/v3/users/35335aa619474ed5a5f6b04e6a89efaf` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.492358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f9533-5f01-4abe-884e-719c5ccb36dd None admin] RBAC: Authorizing `identity:get_user(user_id=35335aa619474ed5a5f6b04e6a89efaf)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.498570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f9533-5f01-4abe-884e-719c5ccb36dd None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.498570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 88/166] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:09 2022] GET /identity/v3/users/35335aa619474ed5a5f6b04e6a89efaf => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:09.498570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93010ac4-1bbd-4497-99bf-807ef067d6fd None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.498570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93010ac4-1bbd-4497-99bf-807ef067d6fd None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.498570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93010ac4-1bbd-4497-99bf-807ef067d6fd None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.498946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 89/167] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:09.503879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93010ac4-1bbd-4497-99bf-807ef067d6fd None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.530330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:09.544892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:09.566415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 79/168] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:09.568110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d179f-8702-4b20-a91e-b783c9e9919e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.568616 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d179f-8702-4b20-a91e-b783c9e9919e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.569086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d179f-8702-4b20-a91e-b783c9e9919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.608574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-440d179f-8702-4b20-a91e-b783c9e9919e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:09.610204 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-440d179f-8702-4b20-a91e-b783c9e9919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:09.669299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93010ac4-1bbd-4497-99bf-807ef067d6fd None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.729571 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73af6a4-e749-4c67-bc4f-d9a2fe9338e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.730329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73af6a4-e749-4c67-bc4f-d9a2fe9338e8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.730562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73af6a4-e749-4c67-bc4f-d9a2fe9338e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.730836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73af6a4-e749-4c67-bc4f-d9a2fe9338e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.786508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 80/169] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:09.787294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d179f-8702-4b20-a91e-b783c9e9919e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.870800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73af6a4-e749-4c67-bc4f-d9a2fe9338e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.872373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73af6a4-e749-4c67-bc4f-d9a2fe9338e8 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.921447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:09.982750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d179f-8702-4b20-a91e-b783c9e9919e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:10.009357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:10.035810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c6895-6cfc-4f53-bf2a-d391d2e238f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:10.036753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c6895-6cfc-4f53-bf2a-d391d2e238f0 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.036972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c6895-6cfc-4f53-bf2a-d391d2e238f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.037243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c6895-6cfc-4f53-bf2a-d391d2e238f0 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.038499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c6895-6cfc-4f53-bf2a-d391d2e238f0 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:10.040009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c6895-6cfc-4f53-bf2a-d391d2e238f0 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:10.042060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 81/170] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:09 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:10.042678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c6895-6cfc-4f53-bf2a-d391d2e238f0 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:10.100074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 90/171] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:10.101036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73af6a4-e749-4c67-bc4f-d9a2fe9338e8 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:10.246766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c6895-6cfc-4f53-bf2a-d391d2e238f0 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:10.285844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73af6a4-e749-4c67-bc4f-d9a2fe9338e8 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:10.311958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:10.320900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d379-8a82-4ec3-b8fb-fa0480edfb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:10.322050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d379-8a82-4ec3-b8fb-fa0480edfb80 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.322540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d379-8a82-4ec3-b8fb-fa0480edfb80 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.323018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d379-8a82-4ec3-b8fb-fa0480edfb80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.328811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b121c3-002a-4547-8d96-4827dde6366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:10.329535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b121c3-002a-4547-8d96-4827dde6366d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.329824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b121c3-002a-4547-8d96-4827dde6366d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.330102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b121c3-002a-4547-8d96-4827dde6366d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.330952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b121c3-002a-4547-8d96-4827dde6366d None admin] RBAC: Adding query filter params (role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=31d62d27680a4a5c899151375f3273a4, user.id=f0bc925e5a06416393e984ad52522227) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:10.331262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b121c3-002a-4547-8d96-4827dde6366d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:10.332751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b121c3-002a-4547-8d96-4827dde6366d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:10.344274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 91/172] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:10 2022] GET /identity/v3/role_assignments?user.id=f0bc925e5a06416393e984ad52522227&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:10.346544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888d379-8a82-4ec3-b8fb-fa0480edfb80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-d888d379-8a82-4ec3-b8fb-fa0480edfb80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:10.354524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:10.355604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:10.356443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:10.357059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b121c3-002a-4547-8d96-4827dde6366d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:10.360238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 82/173] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:10.362916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a464-51e4-4291-945e-df6bf22a08e0 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.363321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a464-51e4-4291-945e-df6bf22a08e0 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.363760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a464-51e4-4291-945e-df6bf22a08e0 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.365617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 83/174] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:10.369999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a464-51e4-4291-945e-df6bf22a08e0 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:10.438724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:10.517757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a464-51e4-4291-945e-df6bf22a08e0 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:10.588389 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cdd3d-46d7-42c8-bbad-34cecb572fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:10.589192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cdd3d-46d7-42c8-bbad-34cecb572fa0 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.589481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cdd3d-46d7-42c8-bbad-34cecb572fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.589760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cdd3d-46d7-42c8-bbad-34cecb572fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.590536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cdd3d-46d7-42c8-bbad-34cecb572fa0 None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:10.591017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cdd3d-46d7-42c8-bbad-34cecb572fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:10.593136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cdd3d-46d7-42c8-bbad-34cecb572fa0 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:10.605094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 84/175] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:10.606362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b121c3-002a-4547-8d96-4827dde6366d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:10.606771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856074-68a1-4aee-bc08-2426d5f42067 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.607063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856074-68a1-4aee-bc08-2426d5f42067 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.607341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856074-68a1-4aee-bc08-2426d5f42067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.630266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c3856074-68a1-4aee-bc08-2426d5f42067 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:10.631998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c3856074-68a1-4aee-bc08-2426d5f42067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:10.675060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6213fe-0d13-4eca-9257-84ef5a207798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:10.676013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6213fe-0d13-4eca-9257-84ef5a207798 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.676341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6213fe-0d13-4eca-9257-84ef5a207798 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.676619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6213fe-0d13-4eca-9257-84ef5a207798 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.677930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6213fe-0d13-4eca-9257-84ef5a207798 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:10.681245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6213fe-0d13-4eca-9257-84ef5a207798 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:10.683046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 92/176] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:10 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:10.687931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e44f1-f4b0-46e9-9aca-dc281aac0d07 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.687931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e44f1-f4b0-46e9-9aca-dc281aac0d07 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.687931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e44f1-f4b0-46e9-9aca-dc281aac0d07 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.687931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 93/177] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:10.687931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e44f1-f4b0-46e9-9aca-dc281aac0d07 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:10.733712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 85/178] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:10.735636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f74d27-0d7c-4c17-8ee7-8019ce9f7738 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.736170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f74d27-0d7c-4c17-8ee7-8019ce9f7738 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.736838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f74d27-0d7c-4c17-8ee7-8019ce9f7738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.755213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-10f74d27-0d7c-4c17-8ee7-8019ce9f7738 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:10.757008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-10f74d27-0d7c-4c17-8ee7-8019ce9f7738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:10.767161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:10.788818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:10.816081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e44f1-f4b0-46e9-9aca-dc281aac0d07 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:10.826866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 86/179] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:10.829279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f74d27-0d7c-4c17-8ee7-8019ce9f7738 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:10.851937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb805e-885c-48c2-b412-366d36cea55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:10.852739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb805e-885c-48c2-b412-366d36cea55d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.853022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb805e-885c-48c2-b412-366d36cea55d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.853296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb805e-885c-48c2-b412-366d36cea55d None admin] PATH_INFO: `/v3/users/f0bc925e5a06416393e984ad52522227` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.854528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb805e-885c-48c2-b412-366d36cea55d None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc925e5a06416393e984ad52522227)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:10.856013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb805e-885c-48c2-b412-366d36cea55d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:10.857646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 94/180] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:10 2022] GET /identity/v3/users/f0bc925e5a06416393e984ad52522227 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:10.858806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db4cc-2012-4b15-bf12-f80bc4da6a38 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.859094 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db4cc-2012-4b15-bf12-f80bc4da6a38 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.859408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db4cc-2012-4b15-bf12-f80bc4da6a38 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.860746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 95/181] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:10.862388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db4cc-2012-4b15-bf12-f80bc4da6a38 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:10.932642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f74d27-0d7c-4c17-8ee7-8019ce9f7738 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:10.966022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db4cc-2012-4b15-bf12-f80bc4da6a38 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:10.967509 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182dfdf-0be6-4f26-a786-5918f6f4c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:10.968192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182dfdf-0be6-4f26-a786-5918f6f4c33e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.968478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182dfdf-0be6-4f26-a786-5918f6f4c33e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.968834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182dfdf-0be6-4f26-a786-5918f6f4c33e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.969664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182dfdf-0be6-4f26-a786-5918f6f4c33e None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=31d62d27680a4a5c899151375f3273a4, user.id=35335aa619474ed5a5f6b04e6a89efaf) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:10.969980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182dfdf-0be6-4f26-a786-5918f6f4c33e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:10.971603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182dfdf-0be6-4f26-a786-5918f6f4c33e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:10.977466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 87/182] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:10 2022] GET /identity/v3/role_assignments?user.id=35335aa619474ed5a5f6b04e6a89efaf&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:10.978750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458c363-62bd-4640-b8dc-e642ed32a0d6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:10.979061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458c363-62bd-4640-b8dc-e642ed32a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:10.979327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458c363-62bd-4640-b8dc-e642ed32a0d6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.983626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 88/183] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:10.983626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458c363-62bd-4640-b8dc-e642ed32a0d6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:10.994692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:11.007839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786c6f3-569a-44b5-b5ed-8ffca1e7c093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:11.008653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786c6f3-569a-44b5-b5ed-8ffca1e7c093 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.008996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786c6f3-569a-44b5-b5ed-8ffca1e7c093 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.009323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786c6f3-569a-44b5-b5ed-8ffca1e7c093 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.026665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786c6f3-569a-44b5-b5ed-8ffca1e7c093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:11.031818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-0786c6f3-569a-44b5-b5ed-8ffca1e7c093 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:11.034527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:11.035462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 96/184] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:11.042023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786c6f3-569a-44b5-b5ed-8ffca1e7c093 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:11.120833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458c363-62bd-4640-b8dc-e642ed32a0d6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:11.154923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786c6f3-569a-44b5-b5ed-8ffca1e7c093 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:11.161375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a9a0e-4b42-47d2-bd0a-5757c4ab8fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:11.162506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a9a0e-4b42-47d2-bd0a-5757c4ab8fdf None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.163002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a9a0e-4b42-47d2-bd0a-5757c4ab8fdf None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.163618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a9a0e-4b42-47d2-bd0a-5757c4ab8fdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.177190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a9a0e-4b42-47d2-bd0a-5757c4ab8fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-5d8a9a0e-4b42-47d2-bd0a-5757c4ab8fdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:11.185308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:11.186223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 89/185] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:11.188592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860b5e-41c6-4203-97bf-13fd0aeea56f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.189306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860b5e-41c6-4203-97bf-13fd0aeea56f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.189306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860b5e-41c6-4203-97bf-13fd0aeea56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.201218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e29d3-8d4a-4568-838e-5ec17a42719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:11.202261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e29d3-8d4a-4568-838e-5ec17a42719d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.202613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e29d3-8d4a-4568-838e-5ec17a42719d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.202995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e29d3-8d4a-4568-838e-5ec17a42719d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.207775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8e860b5e-41c6-4203-97bf-13fd0aeea56f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:11.211156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8e860b5e-41c6-4203-97bf-13fd0aeea56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:11.261211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:11.279737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e29d3-8d4a-4568-838e-5ec17a42719d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:11.281792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e29d3-8d4a-4568-838e-5ec17a42719d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:11.286591 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 90/186] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:11.287625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d680f9-aa52-4e33-aec1-a2929c151148 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.287915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d680f9-aa52-4e33-aec1-a2929c151148 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.288181 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d680f9-aa52-4e33-aec1-a2929c151148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.312090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-02d680f9-aa52-4e33-aec1-a2929c151148 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:11.313350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-02d680f9-aa52-4e33-aec1-a2929c151148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:11.327946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:11.381898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 91/187] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:11.382805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d680f9-aa52-4e33-aec1-a2929c151148 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:11.384949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 97/188] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:11.385691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e29d3-8d4a-4568-838e-5ec17a42719d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:11.469102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:11.486808 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e29d3-8d4a-4568-838e-5ec17a42719d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:11.488507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d680f9-aa52-4e33-aec1-a2929c151148 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:11.519864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97381ad6-fc7f-4e56-8e6e-2249299c8a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:11.520526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97381ad6-fc7f-4e56-8e6e-2249299c8a6a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.520808 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97381ad6-fc7f-4e56-8e6e-2249299c8a6a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.521084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97381ad6-fc7f-4e56-8e6e-2249299c8a6a None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.521823 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97381ad6-fc7f-4e56-8e6e-2249299c8a6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:11.522126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97381ad6-fc7f-4e56-8e6e-2249299c8a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:11.522897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c678069-0bfc-460d-b6ea-2e997b77efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:11.523500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97381ad6-fc7f-4e56-8e6e-2249299c8a6a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:11.523618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c678069-0bfc-460d-b6ea-2e997b77efed None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.523921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c678069-0bfc-460d-b6ea-2e997b77efed None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.524201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c678069-0bfc-460d-b6ea-2e997b77efed None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.524946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c678069-0bfc-460d-b6ea-2e997b77efed None admin] RBAC: Adding query filter params (name=reader) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:11.525254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c678069-0bfc-460d-b6ea-2e997b77efed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:11.526634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c678069-0bfc-460d-b6ea-2e997b77efed None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:11.533025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 98/189] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:11.533828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97381ad6-fc7f-4e56-8e6e-2249299c8a6a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:11.537814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 92/190] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:11.537814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c678069-0bfc-460d-b6ea-2e997b77efed None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:11.553303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:11.635029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97381ad6-fc7f-4e56-8e6e-2249299c8a6a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:11.638095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c678069-0bfc-460d-b6ea-2e997b77efed None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:11.668077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704a1ae-a289-4903-bb65-fe5b61a344f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:11.668858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704a1ae-a289-4903-bb65-fe5b61a344f0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.669146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704a1ae-a289-4903-bb65-fe5b61a344f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.669417 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704a1ae-a289-4903-bb65-fe5b61a344f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.670569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704a1ae-a289-4903-bb65-fe5b61a344f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:11.672534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2c300-6b4d-4ffd-9e88-2a9f7d20d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:11.672652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704a1ae-a289-4903-bb65-fe5b61a344f0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:11.673444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2c300-6b4d-4ffd-9e88-2a9f7d20d21b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.673766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2c300-6b4d-4ffd-9e88-2a9f7d20d21b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.674040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2c300-6b4d-4ffd-9e88-2a9f7d20d21b None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.674234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 99/191] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:11.675583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2c300-6b4d-4ffd-9e88-2a9f7d20d21b None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:11.677044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2c300-6b4d-4ffd-9e88-2a9f7d20d21b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:11.678802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 93/192] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:11 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:11.679469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2c300-6b4d-4ffd-9e88-2a9f7d20d21b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:11.679671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704a1ae-a289-4903-bb65-fe5b61a344f0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:11.695795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:11.767791 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:11.783248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704a1ae-a289-4903-bb65-fe5b61a344f0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:11.789048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2c300-6b4d-4ffd-9e88-2a9f7d20d21b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:11.816876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e907b-a125-4897-a7cf-9ef201c0e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:11.817744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e907b-a125-4897-a7cf-9ef201c0e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.818032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e907b-a125-4897-a7cf-9ef201c0e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.818313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e907b-a125-4897-a7cf-9ef201c0e1f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.827842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710999e9-b39d-4224-8e09-3b77d9bbdc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:11.827842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710999e9-b39d-4224-8e09-3b77d9bbdc2d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:11.828981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710999e9-b39d-4224-8e09-3b77d9bbdc2d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:11.829265 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710999e9-b39d-4224-8e09-3b77d9bbdc2d None admin] PATH_INFO: `/v3/users/23a074e3443e4ae1981f8e2831ae5134` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:11.829492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e907b-a125-4897-a7cf-9ef201c0e1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-281e907b-a125-4897-a7cf-9ef201c0e1f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:11.838033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:11.838990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:11.839995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 100/193] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:11.845966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e907b-a125-4897-a7cf-9ef201c0e1f4 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:11.846974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710999e9-b39d-4224-8e09-3b77d9bbdc2d None admin] RBAC: Authorizing `identity:get_user(user_id=23a074e3443e4ae1981f8e2831ae5134)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:11.848542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710999e9-b39d-4224-8e09-3b77d9bbdc2d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:11.850378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 94/194] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:11 2022] GET /identity/v3/users/23a074e3443e4ae1981f8e2831ae5134 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:11.851124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710999e9-b39d-4224-8e09-3b77d9bbdc2d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:11.973011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:12.000647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710999e9-b39d-4224-8e09-3b77d9bbdc2d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:12.001856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e907b-a125-4897-a7cf-9ef201c0e1f4 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:12.034888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad855b3-d6bd-4acf-b3bd-28177e638e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:12.035556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad855b3-d6bd-4acf-b3bd-28177e638e0a None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:12.035864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad855b3-d6bd-4acf-b3bd-28177e638e0a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:12.036089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654ccd-4ff8-4e4a-b170-b3866a3d336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:12.036197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad855b3-d6bd-4acf-b3bd-28177e638e0a None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:12.036830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad855b3-d6bd-4acf-b3bd-28177e638e0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:12.036952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654ccd-4ff8-4e4a-b170-b3866a3d336e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:12.037244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654ccd-4ff8-4e4a-b170-b3866a3d336e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:12.037523 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654ccd-4ff8-4e4a-b170-b3866a3d336e None admin] PATH_INFO: `/v3/users/039e35725f564be99f6cb2c239a23812` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:12.038282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad855b3-d6bd-4acf-b3bd-28177e638e0a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:12.038712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a654ccd-4ff8-4e4a-b170-b3866a3d336e None admin] RBAC: Authorizing `identity:get_user(user_id=039e35725f564be99f6cb2c239a23812)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:12.040362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a654ccd-4ff8-4e4a-b170-b3866a3d336e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:12.042038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 101/195] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:11 2022] GET /identity/v3/users/039e35725f564be99f6cb2c239a23812 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:12.043933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654ccd-4ff8-4e4a-b170-b3866a3d336e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:12.047428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:12.152252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654ccd-4ff8-4e4a-b170-b3866a3d336e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:12.184684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f7549-1743-4d85-a4b7-4fd40b3e099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:12.185376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f7549-1743-4d85-a4b7-4fd40b3e099d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:12.185645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f7549-1743-4d85-a4b7-4fd40b3e099d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:12.185917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f7549-1743-4d85-a4b7-4fd40b3e099d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:12.186753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f7549-1743-4d85-a4b7-4fd40b3e099d None admin] RBAC: Adding query filter params (role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=31d62d27680a4a5c899151375f3273a4, user.id=f0bc925e5a06416393e984ad52522227) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:12.187060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f7549-1743-4d85-a4b7-4fd40b3e099d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:12.189094 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f7549-1743-4d85-a4b7-4fd40b3e099d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:12.190443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 95/196] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:11 2022] POST /identity/v3/users => generated 297 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:12.206000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad855b3-d6bd-4acf-b3bd-28177e638e0a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:12.206153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 102/197] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:12 2022] GET /identity/v3/role_assignments?user.id=f0bc925e5a06416393e984ad52522227&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:12.206153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f7549-1743-4d85-a4b7-4fd40b3e099d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:12.206153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:12.337664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f7549-1743-4d85-a4b7-4fd40b3e099d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:12.359410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad855b3-d6bd-4acf-b3bd-28177e638e0a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:12.383683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad228e-20c4-45a7-904e-aded0b49bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:12.384358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad228e-20c4-45a7-904e-aded0b49bf58 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:12.384691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad228e-20c4-45a7-904e-aded0b49bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:12.385082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad228e-20c4-45a7-904e-aded0b49bf58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:12.401911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df04c0-089e-4a22-af60-0691309a21fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:12.402593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df04c0-089e-4a22-af60-0691309a21fc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:12.402877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df04c0-089e-4a22-af60-0691309a21fc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:12.403296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df04c0-089e-4a22-af60-0691309a21fc None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:12.404212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df04c0-089e-4a22-af60-0691309a21fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:12.404522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df04c0-089e-4a22-af60-0691309a21fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:12.405946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df04c0-089e-4a22-af60-0691309a21fc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:12.416090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 96/198] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:12.416567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df04c0-089e-4a22-af60-0691309a21fc None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:12.469325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad228e-20c4-45a7-904e-aded0b49bf58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:12.470814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad228e-20c4-45a7-904e-aded0b49bf58 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:12.473769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:12.492845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:12.547696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df04c0-089e-4a22-af60-0691309a21fc None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:12.590992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448adc1-a827-40b6-98ed-3ba1d003509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:12.592200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448adc1-a827-40b6-98ed-3ba1d003509d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:12.592494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448adc1-a827-40b6-98ed-3ba1d003509d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:12.592772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448adc1-a827-40b6-98ed-3ba1d003509d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:12.594729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 103/199] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:12.595591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad228e-20c4-45a7-904e-aded0b49bf58 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:12.681504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448adc1-a827-40b6-98ed-3ba1d003509d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:12.683039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448adc1-a827-40b6-98ed-3ba1d003509d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:12.717036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad228e-20c4-45a7-904e-aded0b49bf58 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:12.727926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:12.749766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:12.766448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3ad6-3467-4649-ba64-c029ae8af988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:12.767349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3ad6-3467-4649-ba64-c029ae8af988 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:12.767656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3ad6-3467-4649-ba64-c029ae8af988 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:12.767930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3ad6-3467-4649-ba64-c029ae8af988 None admin] PATH_INFO: `/v3/users/23a074e3443e4ae1981f8e2831ae5134` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:12.769184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3ad6-3467-4649-ba64-c029ae8af988 None admin] RBAC: Authorizing `identity:get_user(user_id=23a074e3443e4ae1981f8e2831ae5134)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:12.771124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3ad6-3467-4649-ba64-c029ae8af988 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:12.773453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 104/200] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:12 2022] GET /identity/v3/users/23a074e3443e4ae1981f8e2831ae5134 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:12.774171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3ad6-3467-4649-ba64-c029ae8af988 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:12.809087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 97/201] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:12.810771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448adc1-a827-40b6-98ed-3ba1d003509d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:12.891423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3ad6-3467-4649-ba64-c029ae8af988 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:12.955147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448adc1-a827-40b6-98ed-3ba1d003509d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:12.958461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d287e61-25a7-400f-b80c-f9957f99ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:12.959476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d287e61-25a7-400f-b80c-f9957f99ccea None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:12.959959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d287e61-25a7-400f-b80c-f9957f99ccea None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:12.960330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d287e61-25a7-400f-b80c-f9957f99ccea None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:12.961634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d287e61-25a7-400f-b80c-f9957f99ccea None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:12.963169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d287e61-25a7-400f-b80c-f9957f99ccea None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:12.965181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 105/202] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:12 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:12.965912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d287e61-25a7-400f-b80c-f9957f99ccea None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:13.004254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d61ec-1c5f-4f7c-8001-457ac4b6aa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:13.004894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d61ec-1c5f-4f7c-8001-457ac4b6aa88 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:13.005169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d61ec-1c5f-4f7c-8001-457ac4b6aa88 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:13.005436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d61ec-1c5f-4f7c-8001-457ac4b6aa88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:13.023982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:13.042244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:13.088665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d287e61-25a7-400f-b80c-f9957f99ccea None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:13.101581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d61ec-1c5f-4f7c-8001-457ac4b6aa88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:13.103964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d61ec-1c5f-4f7c-8001-457ac4b6aa88 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:13.134938 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35febd3-b3cd-47f5-8b41-7087ec979a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:13.136370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35febd3-b3cd-47f5-8b41-7087ec979a83 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:13.137227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35febd3-b3cd-47f5-8b41-7087ec979a83 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:13.137802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35febd3-b3cd-47f5-8b41-7087ec979a83 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:13.139517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35febd3-b3cd-47f5-8b41-7087ec979a83 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:13.141936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35febd3-b3cd-47f5-8b41-7087ec979a83 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:13.144798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 106/203] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:12 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:13.145720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35febd3-b3cd-47f5-8b41-7087ec979a83 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:13.224748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 98/204] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:13.225708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d61ec-1c5f-4f7c-8001-457ac4b6aa88 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:13.285252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:13.287456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35febd3-b3cd-47f5-8b41-7087ec979a83 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:13.299144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:13.324793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66420407-df4e-499d-90d6-120398bc4cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:13.325535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66420407-df4e-499d-90d6-120398bc4cf2 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:13.325828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66420407-df4e-499d-90d6-120398bc4cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:13.326124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66420407-df4e-499d-90d6-120398bc4cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:13.326996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66420407-df4e-499d-90d6-120398bc4cf2 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=00f7b7c66c944591aeea55c51b88d348, user.id=23a074e3443e4ae1981f8e2831ae5134) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:13.327314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66420407-df4e-499d-90d6-120398bc4cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:13.328972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66420407-df4e-499d-90d6-120398bc4cf2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:13.334499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 107/205] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:13 2022] GET /identity/v3/role_assignments?user.id=23a074e3443e4ae1981f8e2831ae5134&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:13.335349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66420407-df4e-499d-90d6-120398bc4cf2 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:13.342391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d61ec-1c5f-4f7c-8001-457ac4b6aa88 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:13.430058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d6fcc-772b-4352-81ac-dd98666c7b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:13.430690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d6fcc-772b-4352-81ac-dd98666c7b2d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:13.430904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d6fcc-772b-4352-81ac-dd98666c7b2d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:13.431176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d6fcc-772b-4352-81ac-dd98666c7b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:13.432062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d6fcc-772b-4352-81ac-dd98666c7b2d None admin] RBAC: Adding query filter params (role.id=30fcc9db6fb54018807b35bc5f6ff66f, scope.project.id=31d62d27680a4a5c899151375f3273a4, user.id=039e35725f564be99f6cb2c239a23812) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:13.432399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d6fcc-772b-4352-81ac-dd98666c7b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:13.433995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d6fcc-772b-4352-81ac-dd98666c7b2d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:13.451985 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 99/206] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:13 2022] GET /identity/v3/role_assignments?user.id=039e35725f564be99f6cb2c239a23812&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=30fcc9db6fb54018807b35bc5f6ff66f => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:13.530797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66420407-df4e-499d-90d6-120398bc4cf2 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:13.584619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b021b-7116-44ab-8c8a-fb95d2bcc81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:13.585488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b021b-7116-44ab-8c8a-fb95d2bcc81a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:13.585772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b021b-7116-44ab-8c8a-fb95d2bcc81a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:13.586052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b021b-7116-44ab-8c8a-fb95d2bcc81a None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:13.587261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b021b-7116-44ab-8c8a-fb95d2bcc81a None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:13.588762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b021b-7116-44ab-8c8a-fb95d2bcc81a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:13.590479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 108/207] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:13 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:13.597060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d6fcc-772b-4352-81ac-dd98666c7b2d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:13.738829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d6fcc-772b-4352-81ac-dd98666c7b2d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:13.775205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:13.809925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d3d08-4608-456f-ae36-d06641463076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:13.811058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d3d08-4608-456f-ae36-d06641463076 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:13.811552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d3d08-4608-456f-ae36-d06641463076 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:13.812074 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d3d08-4608-456f-ae36-d06641463076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:13.814290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d3d08-4608-456f-ae36-d06641463076 None admin] RBAC: Adding query filter params (role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=00f7b7c66c944591aeea55c51b88d348, user.id=23a074e3443e4ae1981f8e2831ae5134) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:13.814867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d3d08-4608-456f-ae36-d06641463076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:13.817767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d3d08-4608-456f-ae36-d06641463076 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:13.835352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 100/208] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:13 2022] GET /identity/v3/role_assignments?user.id=23a074e3443e4ae1981f8e2831ae5134&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:14.815527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae74311-bfc2-4a5b-9225-3331e513279d None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:14.816053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae74311-bfc2-4a5b-9225-3331e513279d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:14.816127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae74311-bfc2-4a5b-9225-3331e513279d None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:14.817477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 109/209] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:14.823192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b37f80-723d-4b07-bf78-e39c3eefa2d6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:14.823665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b37f80-723d-4b07-bf78-e39c3eefa2d6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:14.823842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b37f80-723d-4b07-bf78-e39c3eefa2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:14.841325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a4b37f80-723d-4b07-bf78-e39c3eefa2d6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:14.842757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a4b37f80-723d-4b07-bf78-e39c3eefa2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:14.914138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 101/210] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:14.936000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e6e6-06f1-4d69-a34b-de817b1e4cfa None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:14.936251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e6e6-06f1-4d69-a34b-de817b1e4cfa None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:14.936536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e6e6-06f1-4d69-a34b-de817b1e4cfa None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:14.937128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b37f80-723d-4b07-bf78-e39c3eefa2d6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:14.938230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 110/211] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:14.943153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00597a-c398-4831-a9c7-3a8c42275a7d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:14.943384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00597a-c398-4831-a9c7-3a8c42275a7d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:14.943709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00597a-c398-4831-a9c7-3a8c42275a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:14.961142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3a00597a-c398-4831-a9c7-3a8c42275a7d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:14.962560 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3a00597a-c398-4831-a9c7-3a8c42275a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:15.007377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:15.051588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 111/212] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:15.055963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b37f80-723d-4b07-bf78-e39c3eefa2d6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:15.080518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00597a-c398-4831-a9c7-3a8c42275a7d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.082045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:15.105788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d478-b2c7-4c6b-8b58-c73578163b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:15.106674 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d478-b2c7-4c6b-8b58-c73578163b21 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.107015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d478-b2c7-4c6b-8b58-c73578163b21 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.107294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d478-b2c7-4c6b-8b58-c73578163b21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.119723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693d478-b2c7-4c6b-8b58-c73578163b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-8693d478-b2c7-4c6b-8b58-c73578163b21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:15.129543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:15.130469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:15.131740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 102/213] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:15.136647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d478-b2c7-4c6b-8b58-c73578163b21 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.191199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00597a-c398-4831-a9c7-3a8c42275a7d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:15.228973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4a876-6f4b-49c2-8a72-a88769ef3fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:15.230680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4a876-6f4b-49c2-8a72-a88769ef3fae None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.231143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4a876-6f4b-49c2-8a72-a88769ef3fae None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.231611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4a876-6f4b-49c2-8a72-a88769ef3fae None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.233435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4a876-6f4b-49c2-8a72-a88769ef3fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:15.235117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4a876-6f4b-49c2-8a72-a88769ef3fae None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:15.242882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 112/214] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:15.245080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4a876-6f4b-49c2-8a72-a88769ef3fae None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.257253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d478-b2c7-4c6b-8b58-c73578163b21 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:15.295991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f95aa-e823-4714-9be2-3f76c193eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:15.297046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f95aa-e823-4714-9be2-3f76c193eb06 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.297808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f95aa-e823-4714-9be2-3f76c193eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.297808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f95aa-e823-4714-9be2-3f76c193eb06 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.298266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f95aa-e823-4714-9be2-3f76c193eb06 None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:15.298640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f95aa-e823-4714-9be2-3f76c193eb06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:15.300258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f95aa-e823-4714-9be2-3f76c193eb06 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:15.301871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:15.315989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 103/215] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:15.317157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f95aa-e823-4714-9be2-3f76c193eb06 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.357861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:15.365350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4a876-6f4b-49c2-8a72-a88769ef3fae None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:15.401776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f22905-82cf-458b-bf64-7f9150fea953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:15.402442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22905-82cf-458b-bf64-7f9150fea953 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.402721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22905-82cf-458b-bf64-7f9150fea953 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.403066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22905-82cf-458b-bf64-7f9150fea953 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.403806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f22905-82cf-458b-bf64-7f9150fea953 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:15.405355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f22905-82cf-458b-bf64-7f9150fea953 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:15.432541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f95aa-e823-4714-9be2-3f76c193eb06 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:15.468311 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516af38-c198-415b-b119-236fccdefd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:15.470003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516af38-c198-415b-b119-236fccdefd39 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.470470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516af38-c198-415b-b119-236fccdefd39 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.471006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516af38-c198-415b-b119-236fccdefd39 None admin] PATH_INFO: `/v3/users/2e31d12038ba4d8bb31e21e20693ac53` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.489073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516af38-c198-415b-b119-236fccdefd39 None admin] RBAC: Authorizing `identity:get_user(user_id=2e31d12038ba4d8bb31e21e20693ac53)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:15.489073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516af38-c198-415b-b119-236fccdefd39 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:15.489073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 104/216] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:15 2022] GET /identity/v3/users/2e31d12038ba4d8bb31e21e20693ac53 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:15.493681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516af38-c198-415b-b119-236fccdefd39 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.529422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 113/217] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:15 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:15.602025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:15.610480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516af38-c198-415b-b119-236fccdefd39 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:15.653471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a812d9-7f16-4196-8cf6-ff351b24140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:15.654191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a812d9-7f16-4196-8cf6-ff351b24140d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.655014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a812d9-7f16-4196-8cf6-ff351b24140d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.655294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a812d9-7f16-4196-8cf6-ff351b24140d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.734880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a812d9-7f16-4196-8cf6-ff351b24140d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:15.736860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a812d9-7f16-4196-8cf6-ff351b24140d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:15.797585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626a6b-fc47-4d57-85f2-52b967de919b None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.798197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626a6b-fc47-4d57-85f2-52b967de919b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.798732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626a6b-fc47-4d57-85f2-52b967de919b None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.800486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 114/218] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:15.805935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5482-8f44-40dd-bb62-99b448c8c085 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.806585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5482-8f44-40dd-bb62-99b448c8c085 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.806866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5482-8f44-40dd-bb62-99b448c8c085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.836662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-735a5482-8f44-40dd-bb62-99b448c8c085 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:15.837850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-735a5482-8f44-40dd-bb62-99b448c8c085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:15.841177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:15.850569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 105/219] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:15.856299 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a812d9-7f16-4196-8cf6-ff351b24140d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.941129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 115/220] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:15.969508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5482-8f44-40dd-bb62-99b448c8c085 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.984070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a812d9-7f16-4196-8cf6-ff351b24140d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.004066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:16.026653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9622b-88b2-4e38-a5de-93066cd4a2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.027601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9622b-88b2-4e38-a5de-93066cd4a2dc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.027894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9622b-88b2-4e38-a5de-93066cd4a2dc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.028168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9622b-88b2-4e38-a5de-93066cd4a2dc None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.029390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9622b-88b2-4e38-a5de-93066cd4a2dc None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:16.030870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9622b-88b2-4e38-a5de-93066cd4a2dc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:16.032933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 106/221] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:15 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:16.042881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9622b-88b2-4e38-a5de-93066cd4a2dc None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.109659 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5482-8f44-40dd-bb62-99b448c8c085 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.132917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:16.173209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68a2c9-22d6-4643-b4c2-491bed0dd1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.174070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68a2c9-22d6-4643-b4c2-491bed0dd1e0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.174397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68a2c9-22d6-4643-b4c2-491bed0dd1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.174680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68a2c9-22d6-4643-b4c2-491bed0dd1e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.195136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68a2c9-22d6-4643-b4c2-491bed0dd1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:16.206315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9622b-88b2-4e38-a5de-93066cd4a2dc None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-1e68a2c9-22d6-4643-b4c2-491bed0dd1e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:16.210771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:16.211770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:16.212587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 116/222] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:16.224716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68a2c9-22d6-4643-b4c2-491bed0dd1e0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.248565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda6020-cedd-4696-b480-c3178be617a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.249578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda6020-cedd-4696-b480-c3178be617a5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.250513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda6020-cedd-4696-b480-c3178be617a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.250983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda6020-cedd-4696-b480-c3178be617a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.252067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda6020-cedd-4696-b480-c3178be617a5 None admin] RBAC: Adding query filter params (role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=00f7b7c66c944591aeea55c51b88d348, user.id=2e31d12038ba4d8bb31e21e20693ac53) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:16.252525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda6020-cedd-4696-b480-c3178be617a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:16.254314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda6020-cedd-4696-b480-c3178be617a5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:16.261117 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 107/223] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:16 2022] GET /identity/v3/role_assignments?user.id=2e31d12038ba4d8bb31e21e20693ac53&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:16.297652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb30e9d-6f75-4318-b678-89465efa2e8b None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.298262 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb30e9d-6f75-4318-b678-89465efa2e8b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.299006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb30e9d-6f75-4318-b678-89465efa2e8b None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.301917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 108/224] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:16.307439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da4564-2328-46ff-885c-3d3950ac2aed None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.310566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da4564-2328-46ff-885c-3d3950ac2aed None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.311124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da4564-2328-46ff-885c-3d3950ac2aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.352723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-44da4564-2328-46ff-885c-3d3950ac2aed None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:16.353944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-44da4564-2328-46ff-885c-3d3950ac2aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:16.382153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:16.400931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68a2c9-22d6-4643-b4c2-491bed0dd1e0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.447213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba67d82-7be0-425c-9f89-ae57002efe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.449702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba67d82-7be0-425c-9f89-ae57002efe15 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.450218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba67d82-7be0-425c-9f89-ae57002efe15 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.451693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba67d82-7be0-425c-9f89-ae57002efe15 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.452811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba67d82-7be0-425c-9f89-ae57002efe15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:16.458575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba67d82-7be0-425c-9f89-ae57002efe15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:16.460367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba67d82-7be0-425c-9f89-ae57002efe15 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:16.470390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 117/225] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:16.476492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba67d82-7be0-425c-9f89-ae57002efe15 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.513797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 109/226] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:16.551845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da4564-2328-46ff-885c-3d3950ac2aed None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.583717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba67d82-7be0-425c-9f89-ae57002efe15 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.620602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351b8ac-64ed-40c3-9622-f01a626976f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.621894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b8ac-64ed-40c3-9622-f01a626976f3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.622404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b8ac-64ed-40c3-9622-f01a626976f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.622880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b8ac-64ed-40c3-9622-f01a626976f3 None admin] PATH_INFO: `/v3/users/23a074e3443e4ae1981f8e2831ae5134` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.624382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351b8ac-64ed-40c3-9622-f01a626976f3 None admin] RBAC: Authorizing `identity:get_user(user_id=23a074e3443e4ae1981f8e2831ae5134)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:16.626173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351b8ac-64ed-40c3-9622-f01a626976f3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:16.628442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 118/227] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:16 2022] GET /identity/v3/users/23a074e3443e4ae1981f8e2831ae5134 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:16.634145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351b8ac-64ed-40c3-9622-f01a626976f3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.660191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:16.663955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:16.744434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da4564-2328-46ff-885c-3d3950ac2aed None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.746112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351b8ac-64ed-40c3-9622-f01a626976f3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.786909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2678a-fb24-48eb-b207-33aed1e6b589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.788258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2678a-fb24-48eb-b207-33aed1e6b589 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.788767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2678a-fb24-48eb-b207-33aed1e6b589 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.789242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2678a-fb24-48eb-b207-33aed1e6b589 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.790673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2678a-fb24-48eb-b207-33aed1e6b589 None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:16.792461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2678a-fb24-48eb-b207-33aed1e6b589 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:16.800122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 119/228] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:16 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:16.801341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2678a-fb24-48eb-b207-33aed1e6b589 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.822930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b0e9-67f1-467f-9c87-5298a78fdaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.823916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b0e9-67f1-467f-9c87-5298a78fdaee None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.824205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b0e9-67f1-467f-9c87-5298a78fdaee None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.824482 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b0e9-67f1-467f-9c87-5298a78fdaee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.856672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402b0e9-67f1-467f-9c87-5298a78fdaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-7402b0e9-67f1-467f-9c87-5298a78fdaee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:16.866846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:16.869621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:16.870446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 110/229] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:16.874061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b0e9-67f1-467f-9c87-5298a78fdaee None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.961424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:16.999475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2678a-fb24-48eb-b207-33aed1e6b589 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.071136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134798fd-05eb-4013-86f3-a4cf2a171736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.072230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134798fd-05eb-4013-86f3-a4cf2a171736 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.072519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134798fd-05eb-4013-86f3-a4cf2a171736 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.072798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134798fd-05eb-4013-86f3-a4cf2a171736 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348/users/23a074e3443e4ae1981f8e2831ae5134/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.076583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134798fd-05eb-4013-86f3-a4cf2a171736 None admin] RBAC: Authorizing `identity:create_grant(project_id=00f7b7c66c944591aeea55c51b88d348, user_id=23a074e3443e4ae1981f8e2831ae5134, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.080067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134798fd-05eb-4013-86f3-a4cf2a171736 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.094452 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b0e9-67f1-467f-9c87-5298a78fdaee None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.112496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:17.130993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e7f95-3a74-431c-b3c0-08433f0b0c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.131881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e7f95-3a74-431c-b3c0-08433f0b0c57 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.132214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e7f95-3a74-431c-b3c0-08433f0b0c57 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.132499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e7f95-3a74-431c-b3c0-08433f0b0c57 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.133309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e7f95-3a74-431c-b3c0-08433f0b0c57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:17.133622 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e7f95-3a74-431c-b3c0-08433f0b0c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.135031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e7f95-3a74-431c-b3c0-08433f0b0c57 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.144543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 111/230] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:17.150342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e7f95-3a74-431c-b3c0-08433f0b0c57 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:17.201591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 120/231] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:42:16 2022] PUT /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348/users/23a074e3443e4ae1981f8e2831ae5134/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:17.266997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e7f95-3a74-431c-b3c0-08433f0b0c57 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.315303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ad096-ef85-4b90-b57c-02fe8b5dcd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.316300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ad096-ef85-4b90-b57c-02fe8b5dcd14 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.316586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ad096-ef85-4b90-b57c-02fe8b5dcd14 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.316860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ad096-ef85-4b90-b57c-02fe8b5dcd14 None admin] PATH_INFO: `/v3/users/23a074e3443e4ae1981f8e2831ae5134` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.318173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ad096-ef85-4b90-b57c-02fe8b5dcd14 None admin] RBAC: Authorizing `identity:get_user(user_id=23a074e3443e4ae1981f8e2831ae5134)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.319660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ad096-ef85-4b90-b57c-02fe8b5dcd14 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.321325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 112/232] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:17 2022] GET /identity/v3/users/23a074e3443e4ae1981f8e2831ae5134 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:17.327097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134798fd-05eb-4013-86f3-a4cf2a171736 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:17.468625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134798fd-05eb-4013-86f3-a4cf2a171736 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.513971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3816cb-a4b4-4b0a-ab1c-a17c1d11699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.514848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3816cb-a4b4-4b0a-ab1c-a17c1d11699a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.515193 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3816cb-a4b4-4b0a-ab1c-a17c1d11699a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.516005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3816cb-a4b4-4b0a-ab1c-a17c1d11699a None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.517284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3816cb-a4b4-4b0a-ab1c-a17c1d11699a None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.518686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3816cb-a4b4-4b0a-ab1c-a17c1d11699a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.520436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 121/233] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:17 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:17.526307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ad096-ef85-4b90-b57c-02fe8b5dcd14 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:17.578758 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:17.640114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ad096-ef85-4b90-b57c-02fe8b5dcd14 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.684996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b2047-9e3f-41a9-b9d0-c5a860f6487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.685897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2047-9e3f-41a9-b9d0-c5a860f6487b None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.686185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2047-9e3f-41a9-b9d0-c5a860f6487b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.686466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2047-9e3f-41a9-b9d0-c5a860f6487b None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348/users/23a074e3443e4ae1981f8e2831ae5134/roles/0c702df8791a47cb89a43521d61e4f21` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.693506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b2047-9e3f-41a9-b9d0-c5a860f6487b None admin] RBAC: Authorizing `identity:create_grant(project_id=00f7b7c66c944591aeea55c51b88d348, user_id=23a074e3443e4ae1981f8e2831ae5134, role_id=0c702df8791a47cb89a43521d61e4f21)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.695097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b2047-9e3f-41a9-b9d0-c5a860f6487b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.830453 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 113/234] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:42:17 2022] PUT /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348/users/23a074e3443e4ae1981f8e2831ae5134/roles/0c702df8791a47cb89a43521d61e4f21 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:18.295625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f109a5-f254-49ff-8777-7c8cd2171253 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.296136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f109a5-f254-49ff-8777-7c8cd2171253 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.296210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f109a5-f254-49ff-8777-7c8cd2171253 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.298273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 122/235] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:18.303641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cfd93-494b-453f-a7e1-6cd4b63ed1a2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.304121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cfd93-494b-453f-a7e1-6cd4b63ed1a2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.304199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cfd93-494b-453f-a7e1-6cd4b63ed1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.329987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-267cfd93-494b-453f-a7e1-6cd4b63ed1a2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:18.331198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-267cfd93-494b-453f-a7e1-6cd4b63ed1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:18.427324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 114/236] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:18.462799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f109a5-f254-49ff-8777-7c8cd2171253 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.481613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:18.606626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f109a5-f254-49ff-8777-7c8cd2171253 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.650685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f2fc2-c4ae-460a-89f8-49a6804829f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.651490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f2fc2-c4ae-460a-89f8-49a6804829f1 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.651818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f2fc2-c4ae-460a-89f8-49a6804829f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.652096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f2fc2-c4ae-460a-89f8-49a6804829f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.668154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f2fc2-c4ae-460a-89f8-49a6804829f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-be1f2fc2-c4ae-460a-89f8-49a6804829f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:18.676195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:18.677117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:18.677916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 123/237] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:18.681107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43263a6d-238b-452b-86b9-724d2fc2d2b3 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.681613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43263a6d-238b-452b-86b9-724d2fc2d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.682290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43263a6d-238b-452b-86b9-724d2fc2d2b3 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.682845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f2fc2-c4ae-460a-89f8-49a6804829f1 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.684502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 115/238] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:18.694775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552a99-92d5-42ae-973b-78d506b70f2b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.695379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552a99-92d5-42ae-973b-78d506b70f2b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.699922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552a99-92d5-42ae-973b-78d506b70f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.738213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-11552a99-92d5-42ae-973b-78d506b70f2b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:18.739432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-11552a99-92d5-42ae-973b-78d506b70f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:18.786788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:18.812455 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:18.849434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f2fc2-c4ae-460a-89f8-49a6804829f1 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.878965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 116/239] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:18.902244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fb2eb-55f8-467b-991b-1bdbcf8b898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.903240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb2eb-55f8-467b-991b-1bdbcf8b898f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.903737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb2eb-55f8-467b-991b-1bdbcf8b898f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.904189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb2eb-55f8-467b-991b-1bdbcf8b898f None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.905171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb2eb-55f8-467b-991b-1bdbcf8b898f None admin] RBAC: Adding query filter params (name=reader) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:18.906354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb2eb-55f8-467b-991b-1bdbcf8b898f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:18.907948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb2eb-55f8-467b-991b-1bdbcf8b898f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:18.913270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11552a99-92d5-42ae-973b-78d506b70f2b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.919849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 124/240] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:18.928526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fb2eb-55f8-467b-991b-1bdbcf8b898f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.051861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fb2eb-55f8-467b-991b-1bdbcf8b898f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.064057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11552a99-92d5-42ae-973b-78d506b70f2b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.084686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:19.090746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca419d5-9ac0-42c9-ad2f-b23b7f6697bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.092236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca419d5-9ac0-42c9-ad2f-b23b7f6697bb None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.092730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca419d5-9ac0-42c9-ad2f-b23b7f6697bb None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.093836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca419d5-9ac0-42c9-ad2f-b23b7f6697bb None admin] PATH_INFO: `/v3/users/42a9b35c72b542f1bde65a7f02d7e168` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.108520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd3a6e-51f9-46b0-b69c-946e653f54ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.109720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca419d5-9ac0-42c9-ad2f-b23b7f6697bb None admin] RBAC: Authorizing `identity:get_user(user_id=42a9b35c72b542f1bde65a7f02d7e168)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:19.109867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3a6e-51f9-46b0-b69c-946e653f54ee None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.110346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3a6e-51f9-46b0-b69c-946e653f54ee None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.110762 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3a6e-51f9-46b0-b69c-946e653f54ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.111839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca419d5-9ac0-42c9-ad2f-b23b7f6697bb None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:19.112122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd3a6e-51f9-46b0-b69c-946e653f54ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:19.113574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd3a6e-51f9-46b0-b69c-946e653f54ee None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:19.114379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 125/241] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:18 2022] GET /identity/v3/users/42a9b35c72b542f1bde65a7f02d7e168 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:19.119154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 117/242] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:19.121001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cba2c-03e2-4139-8060-3a52ec19e367 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.121505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cba2c-03e2-4139-8060-3a52ec19e367 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.122002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cba2c-03e2-4139-8060-3a52ec19e367 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.122388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd3a6e-51f9-46b0-b69c-946e653f54ee None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.128481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 126/243] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:19.129597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cba2c-03e2-4139-8060-3a52ec19e367 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.167915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:19.239057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cba2c-03e2-4139-8060-3a52ec19e367 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.245783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd3a6e-51f9-46b0-b69c-946e653f54ee None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.275865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1420-979c-4716-9579-715fcaa09298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.276918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1420-979c-4716-9579-715fcaa09298 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.277394 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1420-979c-4716-9579-715fcaa09298 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.277871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1420-979c-4716-9579-715fcaa09298 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.278783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1420-979c-4716-9579-715fcaa09298 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:19.281528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1420-979c-4716-9579-715fcaa09298 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:19.283125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d74f6c-45df-47ad-91f9-a98a58cd44ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.283797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d74f6c-45df-47ad-91f9-a98a58cd44ed None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.284118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d74f6c-45df-47ad-91f9-a98a58cd44ed None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.284454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d74f6c-45df-47ad-91f9-a98a58cd44ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.356880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d74f6c-45df-47ad-91f9-a98a58cd44ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:19.358351 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d74f6c-45df-47ad-91f9-a98a58cd44ed None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:19.374807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 127/244] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:19 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:19.380342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea794b-a270-422d-bc42-3392d26fc24d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.380342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea794b-a270-422d-bc42-3392d26fc24d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.380342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea794b-a270-422d-bc42-3392d26fc24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.414725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-2fea794b-a270-422d-bc42-3392d26fc24d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:19.416042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2fea794b-a270-422d-bc42-3392d26fc24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:19.420451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:19.510146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:19.555446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 118/245] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:42:19.561714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 128/246] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:19.563952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d74f6c-45df-47ad-91f9-a98a58cd44ed None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.593362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea794b-a270-422d-bc42-3392d26fc24d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.722157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea794b-a270-422d-bc42-3392d26fc24d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.733286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d74f6c-45df-47ad-91f9-a98a58cd44ed None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.763013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7eed1-674a-4920-9aa3-00ad8aac6aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.763863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7eed1-674a-4920-9aa3-00ad8aac6aad None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.764369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7eed1-674a-4920-9aa3-00ad8aac6aad None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.764650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7eed1-674a-4920-9aa3-00ad8aac6aad None admin] PATH_INFO: `/v3/roles/member` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.778581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7eed1-674a-4920-9aa3-00ad8aac6aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:19.779193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82947b6a-25db-495e-8ee6-5d344889fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.780304 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82947b6a-25db-495e-8ee6-5d344889fab2 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.780876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82947b6a-25db-495e-8ee6-5d344889fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.782029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82947b6a-25db-495e-8ee6-5d344889fab2 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.784198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82947b6a-25db-495e-8ee6-5d344889fab2 None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:19.785920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82947b6a-25db-495e-8ee6-5d344889fab2 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-67e7eed1-674a-4920-9aa3-00ad8aac6aad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:19.786756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:19.787691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:19.792307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 129/247] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:19.793257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 119/248] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:19 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:19.797780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7eed1-674a-4920-9aa3-00ad8aac6aad None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.798507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82947b6a-25db-495e-8ee6-5d344889fab2 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.801608 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:19.858698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:19.942379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7eed1-674a-4920-9aa3-00ad8aac6aad None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.949131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82947b6a-25db-495e-8ee6-5d344889fab2 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.989388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d723f0-a3b4-4f86-a62e-24a47c061813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.990307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d723f0-a3b4-4f86-a62e-24a47c061813 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.990725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d723f0-a3b4-4f86-a62e-24a47c061813 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.991160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d723f0-a3b4-4f86-a62e-24a47c061813 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.991962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d723f0-a3b4-4f86-a62e-24a47c061813 None admin] RBAC: Adding query filter params (name=member) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:19.992451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d723f0-a3b4-4f86-a62e-24a47c061813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:19.994073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d723f0-a3b4-4f86-a62e-24a47c061813 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:19.995344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea05f89-c467-49ab-96f2-d5bbef4313ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.996231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea05f89-c467-49ab-96f2-d5bbef4313ce None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.996684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea05f89-c467-49ab-96f2-d5bbef4313ce None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.996957 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea05f89-c467-49ab-96f2-d5bbef4313ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.997778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea05f89-c467-49ab-96f2-d5bbef4313ce None admin] RBAC: Adding query filter params (role.id=30fcc9db6fb54018807b35bc5f6ff66f, scope.project.id=00f7b7c66c944591aeea55c51b88d348, user.id=42a9b35c72b542f1bde65a7f02d7e168) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:19.998228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea05f89-c467-49ab-96f2-d5bbef4313ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.000557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea05f89-c467-49ab-96f2-d5bbef4313ce None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.004045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 130/249] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:20.005578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816cfb2-b732-416b-830b-12574d7f104a None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.006103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816cfb2-b732-416b-830b-12574d7f104a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.006579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816cfb2-b732-416b-830b-12574d7f104a None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.007828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 120/250] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:19 2022] GET /identity/v3/role_assignments?user.id=42a9b35c72b542f1bde65a7f02d7e168&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=30fcc9db6fb54018807b35bc5f6ff66f => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:20.009091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 131/251] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:20.015484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf046-5864-474d-b88a-55e8bc72e2e0 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.015895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf046-5864-474d-b88a-55e8bc72e2e0 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.016276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf046-5864-474d-b88a-55e8bc72e2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.017883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816cfb2-b732-416b-830b-12574d7f104a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.036515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-02adf046-5864-474d-b88a-55e8bc72e2e0 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:20.038008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-02adf046-5864-474d-b88a-55e8bc72e2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.140873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:20.151922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 121/252] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:20.153115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:20.168395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816cfb2-b732-416b-830b-12574d7f104a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.178565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adf046-5864-474d-b88a-55e8bc72e2e0 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.216688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7374e-e03b-4e23-8f85-6d741b79d1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.217812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7374e-e03b-4e23-8f85-6d741b79d1dc None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.218096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7374e-e03b-4e23-8f85-6d741b79d1dc None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.218368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7374e-e03b-4e23-8f85-6d741b79d1dc None admin] PATH_INFO: `/v3/users/2e31d12038ba4d8bb31e21e20693ac53` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.219925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7374e-e03b-4e23-8f85-6d741b79d1dc None admin] RBAC: Authorizing `identity:get_user(user_id=2e31d12038ba4d8bb31e21e20693ac53)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.223602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7374e-e03b-4e23-8f85-6d741b79d1dc None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.225866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 132/253] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:20 2022] GET /identity/v3/users/2e31d12038ba4d8bb31e21e20693ac53 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:20.233384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7374e-e03b-4e23-8f85-6d741b79d1dc None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.330661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adf046-5864-474d-b88a-55e8bc72e2e0 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.378434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da56455-c848-4d6b-8334-d94b1d650f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.380487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da56455-c848-4d6b-8334-d94b1d650f9f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.380918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da56455-c848-4d6b-8334-d94b1d650f9f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.381360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da56455-c848-4d6b-8334-d94b1d650f9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.382342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7374e-e03b-4e23-8f85-6d741b79d1dc None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.394852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da56455-c848-4d6b-8334-d94b1d650f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-7da56455-c848-4d6b-8334-d94b1d650f9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:20.405405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:20.407078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:20.408105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:20.410936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 122/254] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:20.416914 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da56455-c848-4d6b-8334-d94b1d650f9f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.434421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575b30d-ade2-4ed1-bc71-100ace1a4184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.435969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575b30d-ade2-4ed1-bc71-100ace1a4184 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.436880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575b30d-ade2-4ed1-bc71-100ace1a4184 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.437342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575b30d-ade2-4ed1-bc71-100ace1a4184 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.439351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575b30d-ade2-4ed1-bc71-100ace1a4184 None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.441673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575b30d-ade2-4ed1-bc71-100ace1a4184 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.444477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 133/255] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:20 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:20.450497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575b30d-ade2-4ed1-bc71-100ace1a4184 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.484663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:20.507636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:20.533251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da56455-c848-4d6b-8334-d94b1d650f9f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.594382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb971-62be-4720-b17c-cf3dbbd5090c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.595327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb971-62be-4720-b17c-cf3dbbd5090c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.595781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb971-62be-4720-b17c-cf3dbbd5090c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.596200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb971-62be-4720-b17c-cf3dbbd5090c None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.597397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffb971-62be-4720-b17c-cf3dbbd5090c None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:20.599173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffb971-62be-4720-b17c-cf3dbbd5090c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.600847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffb971-62be-4720-b17c-cf3dbbd5090c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.624169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 123/256] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:20.627359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575b30d-ade2-4ed1-bc71-100ace1a4184 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.628461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb971-62be-4720-b17c-cf3dbbd5090c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.703043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272b111-1098-4271-8523-b9f097d9a57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.704165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b111-1098-4271-8523-b9f097d9a57c None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.704589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b111-1098-4271-8523-b9f097d9a57c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.705001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b111-1098-4271-8523-b9f097d9a57c None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348/users/2e31d12038ba4d8bb31e21e20693ac53/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.707178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272b111-1098-4271-8523-b9f097d9a57c None admin] RBAC: Authorizing `identity:create_grant(project_id=00f7b7c66c944591aeea55c51b88d348, user_id=2e31d12038ba4d8bb31e21e20693ac53, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.708865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272b111-1098-4271-8523-b9f097d9a57c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.838975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb971-62be-4720-b17c-cf3dbbd5090c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.849878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 134/257] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:42:20 2022] PUT /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348/users/2e31d12038ba4d8bb31e21e20693ac53/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:20.855498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065df0-d922-434b-b0bc-e154dc43c0bc None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.856379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065df0-d922-434b-b0bc-e154dc43c0bc None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.856976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065df0-d922-434b-b0bc-e154dc43c0bc None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.858865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 135/258] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:20.863140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:20.865002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03503-ed83-4bda-8c3b-de41a0e01283 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.865550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03503-ed83-4bda-8c3b-de41a0e01283 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.866051 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03503-ed83-4bda-8c3b-de41a0e01283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.888039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365b56f-99df-4baa-ba01-79b8c7337227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.888927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b56f-99df-4baa-ba01-79b8c7337227 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.889214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b56f-99df-4baa-ba01-79b8c7337227 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.895691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b56f-99df-4baa-ba01-79b8c7337227 None admin] PATH_INFO: `/v3/users/23a074e3443e4ae1981f8e2831ae5134` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.896751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365b56f-99df-4baa-ba01-79b8c7337227 None admin] RBAC: Authorizing `identity:get_user(user_id=23a074e3443e4ae1981f8e2831ae5134)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.898592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365b56f-99df-4baa-ba01-79b8c7337227 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.900368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 124/259] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:20 2022] GET /identity/v3/users/23a074e3443e4ae1981f8e2831ae5134 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:20.907734 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-81c03503-ed83-4bda-8c3b-de41a0e01283 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:20.909464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-81c03503-ed83-4bda-8c3b-de41a0e01283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.916689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365b56f-99df-4baa-ba01-79b8c7337227 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.055127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 136/260] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:21.091840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03503-ed83-4bda-8c3b-de41a0e01283 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.112250 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365b56f-99df-4baa-ba01-79b8c7337227 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.144145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:21.157258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db5168-3504-4289-bf85-ba8db4394dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.157932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db5168-3504-4289-bf85-ba8db4394dec None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.158211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db5168-3504-4289-bf85-ba8db4394dec None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.158484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db5168-3504-4289-bf85-ba8db4394dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.274194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:21.291942 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db5168-3504-4289-bf85-ba8db4394dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:21.293444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db5168-3504-4289-bf85-ba8db4394dec None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:21.295380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03503-ed83-4bda-8c3b-de41a0e01283 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.342040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29261d2-7a5f-48e0-8602-ac8b91dd31e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.342773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29261d2-7a5f-48e0-8602-ac8b91dd31e1 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.343092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29261d2-7a5f-48e0-8602-ac8b91dd31e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.343370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29261d2-7a5f-48e0-8602-ac8b91dd31e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.360945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29261d2-7a5f-48e0-8602-ac8b91dd31e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-d29261d2-7a5f-48e0-8602-ac8b91dd31e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:21.379321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:21.380318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:21.381106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 137/261] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:21.388237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29261d2-7a5f-48e0-8602-ac8b91dd31e1 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.421894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 125/262] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:21.432596 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db5168-3504-4289-bf85-ba8db4394dec None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.567928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:21.591340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29261d2-7a5f-48e0-8602-ac8b91dd31e1 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.677059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da336bc8-e6c5-404f-88d3-93579cddfc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.678075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da336bc8-e6c5-404f-88d3-93579cddfc69 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.678575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da336bc8-e6c5-404f-88d3-93579cddfc69 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.679042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da336bc8-e6c5-404f-88d3-93579cddfc69 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.680235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:21.680367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da336bc8-e6c5-404f-88d3-93579cddfc69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:21.680367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da336bc8-e6c5-404f-88d3-93579cddfc69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:21.681746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da336bc8-e6c5-404f-88d3-93579cddfc69 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:21.701761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 138/263] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:21.707695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da336bc8-e6c5-404f-88d3-93579cddfc69 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.719205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db5168-3504-4289-bf85-ba8db4394dec None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.784520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd557a-5c72-4af0-9ce9-a6120a04921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.786136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd557a-5c72-4af0-9ce9-a6120a04921b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.786632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd557a-5c72-4af0-9ce9-a6120a04921b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.787127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd557a-5c72-4af0-9ce9-a6120a04921b None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.788743 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd557a-5c72-4af0-9ce9-a6120a04921b None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:21.795585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd557a-5c72-4af0-9ce9-a6120a04921b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:21.797885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 126/264] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:21 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:21.804970 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd557a-5c72-4af0-9ce9-a6120a04921b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.977979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da336bc8-e6c5-404f-88d3-93579cddfc69 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.035249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daa708-4db4-4120-80a1-8d38dd00d9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.036471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daa708-4db4-4120-80a1-8d38dd00d9b7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.036762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daa708-4db4-4120-80a1-8d38dd00d9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.037041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daa708-4db4-4120-80a1-8d38dd00d9b7 None admin] PATH_INFO: `/v3/users/23a074e3443e4ae1981f8e2831ae5134` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.043595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76daa708-4db4-4120-80a1-8d38dd00d9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=23a074e3443e4ae1981f8e2831ae5134)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.043595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76daa708-4db4-4120-80a1-8d38dd00d9b7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.044706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 139/265] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:21 2022] GET /identity/v3/users/23a074e3443e4ae1981f8e2831ae5134 => generated 283 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:22.049805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daa708-4db4-4120-80a1-8d38dd00d9b7 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.078929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:22.101714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd557a-5c72-4af0-9ce9-a6120a04921b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.227520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f68575-cbfa-445b-98b5-0d90eee2198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.228282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f68575-cbfa-445b-98b5-0d90eee2198f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.228534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f68575-cbfa-445b-98b5-0d90eee2198f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.228965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f68575-cbfa-445b-98b5-0d90eee2198f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.229814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f68575-cbfa-445b-98b5-0d90eee2198f None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=00f7b7c66c944591aeea55c51b88d348, user.id=23a074e3443e4ae1981f8e2831ae5134) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:22.230126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f68575-cbfa-445b-98b5-0d90eee2198f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.231599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f68575-cbfa-445b-98b5-0d90eee2198f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.250789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daa708-4db4-4120-80a1-8d38dd00d9b7 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.253893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 127/266] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:21 2022] GET /identity/v3/role_assignments?user.id=23a074e3443e4ae1981f8e2831ae5134&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 608 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:22.337797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb4dc3-a8a2-46a2-97b4-59fb6805e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.338456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb4dc3-a8a2-46a2-97b4-59fb6805e810 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.338740 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb4dc3-a8a2-46a2-97b4-59fb6805e810 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.339055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb4dc3-a8a2-46a2-97b4-59fb6805e810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.431823 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb4dc3-a8a2-46a2-97b4-59fb6805e810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.433325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb4dc3-a8a2-46a2-97b4-59fb6805e810 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.465063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:22.572108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 140/267] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:22.578685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f68575-cbfa-445b-98b5-0d90eee2198f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.623324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:22.738490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f68575-cbfa-445b-98b5-0d90eee2198f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.779550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bad38-0ca3-4915-9cf1-37155120c72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.780505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bad38-0ca3-4915-9cf1-37155120c72c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.780794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bad38-0ca3-4915-9cf1-37155120c72c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.781073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bad38-0ca3-4915-9cf1-37155120c72c None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.782352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bad38-0ca3-4915-9cf1-37155120c72c None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.783920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bad38-0ca3-4915-9cf1-37155120c72c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.786060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 128/268] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:22 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:22.791914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb4dc3-a8a2-46a2-97b4-59fb6805e810 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.858781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa29702-4a5a-4ad0-b047-08d4848db7b7 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.859075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa29702-4a5a-4ad0-b047-08d4848db7b7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.859271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa29702-4a5a-4ad0-b047-08d4848db7b7 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.860853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 129/269] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:22.877705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b4398-bec6-47c6-9b2f-27be6cea8637 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.878001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b4398-bec6-47c6-9b2f-27be6cea8637 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.878277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b4398-bec6-47c6-9b2f-27be6cea8637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.911606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-193b4398-bec6-47c6-9b2f-27be6cea8637 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.912819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-193b4398-bec6-47c6-9b2f-27be6cea8637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.938328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb4dc3-a8a2-46a2-97b4-59fb6805e810 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.957860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:22.996406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32177f0-24a3-4757-b4c8-01441c73030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.997089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32177f0-24a3-4757-b4c8-01441c73030c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.997550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32177f0-24a3-4757-b4c8-01441c73030c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.997974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32177f0-24a3-4757-b4c8-01441c73030c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.999073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32177f0-24a3-4757-b4c8-01441c73030c None admin] RBAC: Adding query filter params (role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=00f7b7c66c944591aeea55c51b88d348, user.id=23a074e3443e4ae1981f8e2831ae5134) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:23.000352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32177f0-24a3-4757-b4c8-01441c73030c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.002253 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32177f0-24a3-4757-b4c8-01441c73030c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.010101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 141/270] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:22 2022] GET /identity/v3/role_assignments?user.id=23a074e3443e4ae1981f8e2831ae5134&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.036558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 130/271] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:23.073337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32177f0-24a3-4757-b4c8-01441c73030c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.217339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af52342-738a-453b-ac05-d40a364ce8eb None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.217555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af52342-738a-453b-ac05-d40a364ce8eb None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.217815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af52342-738a-453b-ac05-d40a364ce8eb None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.219612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 131/272] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:23.221306 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32177f0-24a3-4757-b4c8-01441c73030c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.225273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005d261-d2b8-4109-86e2-93f7858416a7 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.225583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005d261-d2b8-4109-86e2-93f7858416a7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.225848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005d261-d2b8-4109-86e2-93f7858416a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.252963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0005d261-d2b8-4109-86e2-93f7858416a7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:23.254129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0005d261-d2b8-4109-86e2-93f7858416a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:23.268806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.269589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584391a-ad09-415f-abb0-a78db92e6c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.270649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584391a-ad09-415f-abb0-a78db92e6c73 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.271146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584391a-ad09-415f-abb0-a78db92e6c73 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.271657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584391a-ad09-415f-abb0-a78db92e6c73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.286544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584391a-ad09-415f-abb0-a78db92e6c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-f584391a-ad09-415f-abb0-a78db92e6c73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:23.295269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:23.296761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:23.297589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:23.299648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 142/273] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:23.306068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584391a-ad09-415f-abb0-a78db92e6c73 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.340399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 132/274] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:23.361723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.375629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005d261-d2b8-4109-86e2-93f7858416a7 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.442366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584391a-ad09-415f-abb0-a78db92e6c73 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.481623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea047e-c596-4b61-a572-c391a09995bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.482213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea047e-c596-4b61-a572-c391a09995bf None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.482495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea047e-c596-4b61-a572-c391a09995bf None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.482771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea047e-c596-4b61-a572-c391a09995bf None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.484207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea047e-c596-4b61-a572-c391a09995bf None admin] RBAC: Adding query filter params (name=member) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:23.484529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea047e-c596-4b61-a572-c391a09995bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.485899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea047e-c596-4b61-a572-c391a09995bf None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.494862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 143/275] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:23.496045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4377b-9513-4da1-a0aa-7e60fba1efb5 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.496311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4377b-9513-4da1-a0aa-7e60fba1efb5 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.496656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4377b-9513-4da1-a0aa-7e60fba1efb5 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.497834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 144/276] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:23.499125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005d261-d2b8-4109-86e2-93f7858416a7 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.500423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4377b-9513-4da1-a0aa-7e60fba1efb5 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.537111 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d711ff9-4a6a-44bb-84ed-45d8351bcb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.537887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d711ff9-4a6a-44bb-84ed-45d8351bcb88 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.538163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d711ff9-4a6a-44bb-84ed-45d8351bcb88 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.538432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d711ff9-4a6a-44bb-84ed-45d8351bcb88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.549792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d711ff9-4a6a-44bb-84ed-45d8351bcb88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-0d711ff9-4a6a-44bb-84ed-45d8351bcb88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:23.557633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:23.558545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:23.559369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 133/277] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:23.560139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37576f-a9df-460f-b548-3a53345ed7cb None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.560579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37576f-a9df-460f-b548-3a53345ed7cb None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.560579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37576f-a9df-460f-b548-3a53345ed7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.573425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.578583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-9a37576f-a9df-460f-b548-3a53345ed7cb None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:23.579790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9a37576f-a9df-460f-b548-3a53345ed7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:23.614164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.618721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4377b-9513-4da1-a0aa-7e60fba1efb5 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.652605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 134/278] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:23.653464 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37576f-a9df-460f-b548-3a53345ed7cb None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.665826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a11496-c52a-47d0-b7a4-b0a768ffabab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.667000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a11496-c52a-47d0-b7a4-b0a768ffabab None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.667470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a11496-c52a-47d0-b7a4-b0a768ffabab None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.667948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a11496-c52a-47d0-b7a4-b0a768ffabab None admin] PATH_INFO: `/v3/users/777e21abd83c48aaaaa03fa24eec569b` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.682637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a11496-c52a-47d0-b7a4-b0a768ffabab None admin] RBAC: Authorizing `identity:get_user(user_id=777e21abd83c48aaaaa03fa24eec569b)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.684144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a11496-c52a-47d0-b7a4-b0a768ffabab None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.690852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 145/279] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/users/777e21abd83c48aaaaa03fa24eec569b => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.691742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a11496-c52a-47d0-b7a4-b0a768ffabab None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.778684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37576f-a9df-460f-b548-3a53345ed7cb None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.796176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a11496-c52a-47d0-b7a4-b0a768ffabab None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.814834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08044-f103-4eee-94f5-0243521d2401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.815521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08044-f103-4eee-94f5-0243521d2401 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.815855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08044-f103-4eee-94f5-0243521d2401 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.816425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08044-f103-4eee-94f5-0243521d2401 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.817411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e08044-f103-4eee-94f5-0243521d2401 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:23.817533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e08044-f103-4eee-94f5-0243521d2401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.819059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e08044-f103-4eee-94f5-0243521d2401 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.821595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.829909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 135/280] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.831147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08044-f103-4eee-94f5-0243521d2401 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.846598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729092b-85a9-4684-9d45-ca67be181621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.847873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729092b-85a9-4684-9d45-ca67be181621 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.848455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729092b-85a9-4684-9d45-ca67be181621 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.849302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729092b-85a9-4684-9d45-ca67be181621 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.850981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729092b-85a9-4684-9d45-ca67be181621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.853167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729092b-85a9-4684-9d45-ca67be181621 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.855489 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 146/281] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.856440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729092b-85a9-4684-9d45-ca67be181621 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.887834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.943257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08044-f103-4eee-94f5-0243521d2401 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.968829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729092b-85a9-4684-9d45-ca67be181621 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.978729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400a94-586f-4764-9a1c-4b9736029432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.979494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400a94-586f-4764-9a1c-4b9736029432 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.979818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400a94-586f-4764-9a1c-4b9736029432 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.980097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400a94-586f-4764-9a1c-4b9736029432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.980927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400a94-586f-4764-9a1c-4b9736029432 None admin] RBAC: Adding query filter params (role.id=9921f4d7024b4fec93767ff982451ef7, user.id=777e21abd83c48aaaaa03fa24eec569b, scope.system=all) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:23.981241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400a94-586f-4764-9a1c-4b9736029432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.982927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400a94-586f-4764-9a1c-4b9736029432 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.995594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 136/282] 10.222.0.93 () {56 vars in 1308 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/role_assignments?user.id=777e21abd83c48aaaaa03fa24eec569b&scope.system=all&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:23.995594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400a94-586f-4764-9a1c-4b9736029432 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.019597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1d67d-5604-4413-9c81-88a2c6846f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.020504 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d67d-5604-4413-9c81-88a2c6846f65 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.020786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d67d-5604-4413-9c81-88a2c6846f65 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.021066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d67d-5604-4413-9c81-88a2c6846f65 None admin] PATH_INFO: `/v3/users/42a9b35c72b542f1bde65a7f02d7e168` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.022374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1d67d-5604-4413-9c81-88a2c6846f65 None admin] RBAC: Authorizing `identity:get_user(user_id=42a9b35c72b542f1bde65a7f02d7e168)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.023887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1d67d-5604-4413-9c81-88a2c6846f65 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.025928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 147/283] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:23 2022] GET /identity/v3/users/42a9b35c72b542f1bde65a7f02d7e168 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:24.027242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78bd1-026d-4ad5-b389-fc4b02caa04e None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.027533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78bd1-026d-4ad5-b389-fc4b02caa04e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.027835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78bd1-026d-4ad5-b389-fc4b02caa04e None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.034030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 148/284] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:24.034030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad78bd1-026d-4ad5-b389-fc4b02caa04e None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.080393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:24.122598 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400a94-586f-4764-9a1c-4b9736029432 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.158454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:24.166922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630cc18-749c-4d87-8019-1e8f128bd986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.167146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad78bd1-026d-4ad5-b389-fc4b02caa04e None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.167705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630cc18-749c-4d87-8019-1e8f128bd986 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.167992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630cc18-749c-4d87-8019-1e8f128bd986 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.168267 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630cc18-749c-4d87-8019-1e8f128bd986 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.168994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630cc18-749c-4d87-8019-1e8f128bd986 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.170548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630cc18-749c-4d87-8019-1e8f128bd986 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.202948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30357935-22f6-4da9-99e9-7bad31d6bd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.203836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357935-22f6-4da9-99e9-7bad31d6bd62 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.204127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357935-22f6-4da9-99e9-7bad31d6bd62 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.204402 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357935-22f6-4da9-99e9-7bad31d6bd62 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.205723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30357935-22f6-4da9-99e9-7bad31d6bd62 None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.210395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30357935-22f6-4da9-99e9-7bad31d6bd62 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.211706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 149/285] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:24.212976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dcfff-d7b5-46c6-ade4-285c7b044e02 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.213286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dcfff-d7b5-46c6-ade4-285c7b044e02 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.213564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dcfff-d7b5-46c6-ade4-285c7b044e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.230247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e92dcfff-d7b5-46c6-ade4-285c7b044e02 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:24.231425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e92dcfff-d7b5-46c6-ade4-285c7b044e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:24.298993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 150/286] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:24.299778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dcfff-d7b5-46c6-ade4-285c7b044e02 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.310516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 137/287] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:24.327869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630cc18-749c-4d87-8019-1e8f128bd986 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.425895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:24.438919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dcfff-d7b5-46c6-ade4-285c7b044e02 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.458748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630cc18-749c-4d87-8019-1e8f128bd986 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.479218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:24.492932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1cf1f-d477-469e-9c66-b3f31d341b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.493505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1cf1f-d477-469e-9c66-b3f31d341b7a None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.495015 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1cf1f-d477-469e-9c66-b3f31d341b7a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.495015 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1cf1f-d477-469e-9c66-b3f31d341b7a None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348/users/42a9b35c72b542f1bde65a7f02d7e168/roles/30fcc9db6fb54018807b35bc5f6ff66f` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.496753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1cf1f-d477-469e-9c66-b3f31d341b7a None admin] RBAC: Authorizing `identity:create_grant(project_id=00f7b7c66c944591aeea55c51b88d348, user_id=42a9b35c72b542f1bde65a7f02d7e168, role_id=30fcc9db6fb54018807b35bc5f6ff66f)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.498271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1cf1f-d477-469e-9c66-b3f31d341b7a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.500127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccde9f7-370c-4a96-9144-ec562201c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.501086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccde9f7-370c-4a96-9144-ec562201c231 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.501466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccde9f7-370c-4a96-9144-ec562201c231 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.501745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccde9f7-370c-4a96-9144-ec562201c231 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.513899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccde9f7-370c-4a96-9144-ec562201c231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-dccde9f7-370c-4a96-9144-ec562201c231 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:24.522208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:24.523324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:24.524425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:24.527246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 138/288] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:24.533079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccde9f7-370c-4a96-9144-ec562201c231 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.616623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 151/289] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:42:24 2022] PUT /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348/users/42a9b35c72b542f1bde65a7f02d7e168/roles/30fcc9db6fb54018807b35bc5f6ff66f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:24.642092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccde9f7-370c-4a96-9144-ec562201c231 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.693336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d7ea3-ffee-4b80-b8b3-25cf948450f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.694030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d7ea3-ffee-4b80-b8b3-25cf948450f6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.694309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d7ea3-ffee-4b80-b8b3-25cf948450f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.694583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d7ea3-ffee-4b80-b8b3-25cf948450f6 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.695436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d7ea3-ffee-4b80-b8b3-25cf948450f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:24.695705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d7ea3-ffee-4b80-b8b3-25cf948450f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.697144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d7ea3-ffee-4b80-b8b3-25cf948450f6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.707066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 139/290] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:24.712918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1cf1f-d477-469e-9c66-b3f31d341b7a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.832374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1cf1f-d477-469e-9c66-b3f31d341b7a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.878234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba20e2-5313-4700-a7f9-1330074838eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.879416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba20e2-5313-4700-a7f9-1330074838eb None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.879976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba20e2-5313-4700-a7f9-1330074838eb None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.880418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba20e2-5313-4700-a7f9-1330074838eb None admin] PATH_INFO: `/v3/users/2e31d12038ba4d8bb31e21e20693ac53` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.881857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba20e2-5313-4700-a7f9-1330074838eb None admin] RBAC: Authorizing `identity:get_user(user_id=2e31d12038ba4d8bb31e21e20693ac53)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.883471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba20e2-5313-4700-a7f9-1330074838eb None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.885324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 152/291] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/users/2e31d12038ba4d8bb31e21e20693ac53 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:24.894470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d7ea3-ffee-4b80-b8b3-25cf948450f6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.944534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:25.027153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d7ea3-ffee-4b80-b8b3-25cf948450f6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.080341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7cda5-57f8-4778-ab8f-24ca3a874e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.081018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7cda5-57f8-4778-ab8f-24ca3a874e9a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.081305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7cda5-57f8-4778-ab8f-24ca3a874e9a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.081580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7cda5-57f8-4778-ab8f-24ca3a874e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.172187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7cda5-57f8-4778-ab8f-24ca3a874e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.173571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7cda5-57f8-4778-ab8f-24ca3a874e9a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.231604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:25.316879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 140/292] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:25.321986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba20e2-5313-4700-a7f9-1330074838eb None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.364487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:25.458469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba20e2-5313-4700-a7f9-1330074838eb None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.502673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecf66d-6285-42f1-b7c6-e80dded3024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.503544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecf66d-6285-42f1-b7c6-e80dded3024a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.503846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecf66d-6285-42f1-b7c6-e80dded3024a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.504117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecf66d-6285-42f1-b7c6-e80dded3024a None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.505314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecf66d-6285-42f1-b7c6-e80dded3024a None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.506757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecf66d-6285-42f1-b7c6-e80dded3024a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.508794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 153/293] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:25 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:25.514216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7cda5-57f8-4778-ab8f-24ca3a874e9a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.658454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7cda5-57f8-4778-ab8f-24ca3a874e9a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.716601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61bd96-d7e7-41f4-af8d-5a9462f30b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.717191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61bd96-d7e7-41f4-af8d-5a9462f30b3a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.717525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61bd96-d7e7-41f4-af8d-5a9462f30b3a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.717804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61bd96-d7e7-41f4-af8d-5a9462f30b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.718667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61bd96-d7e7-41f4-af8d-5a9462f30b3a None admin] RBAC: Adding query filter params (role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=00f7b7c66c944591aeea55c51b88d348, user.id=2e31d12038ba4d8bb31e21e20693ac53) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:25.718976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61bd96-d7e7-41f4-af8d-5a9462f30b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.720446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61bd96-d7e7-41f4-af8d-5a9462f30b3a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.726573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 141/294] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:25 2022] GET /identity/v3/role_assignments?user.id=2e31d12038ba4d8bb31e21e20693ac53&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:26.511549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c8af1-e016-43f2-a52d-ba28d52fa9fd None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.512072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c8af1-e016-43f2-a52d-ba28d52fa9fd None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.512147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c8af1-e016-43f2-a52d-ba28d52fa9fd None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.513739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 154/295] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:26.519604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb169df-6eea-4ac9-b7d4-4a864fcc5a92 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.520116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb169df-6eea-4ac9-b7d4-4a864fcc5a92 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.520594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb169df-6eea-4ac9-b7d4-4a864fcc5a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.526895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:26.539707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0eb169df-6eea-4ac9-b7d4-4a864fcc5a92 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:26.541205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0eb169df-6eea-4ac9-b7d4-4a864fcc5a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:26.612192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 142/296] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:26.634142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c8af1-e016-43f2-a52d-ba28d52fa9fd None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.727180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:26.740434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c8af1-e016-43f2-a52d-ba28d52fa9fd None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.775977 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7808-b7bc-4587-a324-736999d0a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.776687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7808-b7bc-4587-a324-736999d0a178 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.776970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7808-b7bc-4587-a324-736999d0a178 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.777249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7808-b7bc-4587-a324-736999d0a178 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.790305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c7808-b7bc-4587-a324-736999d0a178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-208c7808-b7bc-4587-a324-736999d0a178 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:26.798411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:26.799380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:26.800692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 155/297] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:26.806006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb169df-6eea-4ac9-b7d4-4a864fcc5a92 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.912288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb169df-6eea-4ac9-b7d4-4a864fcc5a92 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.951894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a5f44-dc9a-4b7e-9aaf-ee4cee517aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.952624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a5f44-dc9a-4b7e-9aaf-ee4cee517aca None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.952909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a5f44-dc9a-4b7e-9aaf-ee4cee517aca None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.953185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a5f44-dc9a-4b7e-9aaf-ee4cee517aca None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.953961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a5f44-dc9a-4b7e-9aaf-ee4cee517aca None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:26.954272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a5f44-dc9a-4b7e-9aaf-ee4cee517aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.956567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a5f44-dc9a-4b7e-9aaf-ee4cee517aca None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.958040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:26.966038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 143/298] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:26.971915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7808-b7bc-4587-a324-736999d0a178 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.992453 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d5c40-ce0f-4273-9bf2-545f16e0d50a None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.993133 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d5c40-ce0f-4273-9bf2-545f16e0d50a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.993597 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d5c40-ce0f-4273-9bf2-545f16e0d50a None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.995153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 144/299] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:27.001365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648640a-0cdd-48c7-8154-da1b21cc97c4 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.002113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648640a-0cdd-48c7-8154-da1b21cc97c4 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.002606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648640a-0cdd-48c7-8154-da1b21cc97c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.019810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d648640a-0cdd-48c7-8154-da1b21cc97c4 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:27.021238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d648640a-0cdd-48c7-8154-da1b21cc97c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.085928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7808-b7bc-4587-a324-736999d0a178 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.113487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 145/300] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:27.126138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530047-9b65-45de-a9d5-1cc567ba961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.127045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530047-9b65-45de-a9d5-1cc567ba961c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.127299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530047-9b65-45de-a9d5-1cc567ba961c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.127599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530047-9b65-45de-a9d5-1cc567ba961c None admin] PATH_INFO: `/v3/users/777e21abd83c48aaaaa03fa24eec569b` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.128802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b530047-9b65-45de-a9d5-1cc567ba961c None admin] RBAC: Authorizing `identity:get_user(user_id=777e21abd83c48aaaaa03fa24eec569b)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.130255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b530047-9b65-45de-a9d5-1cc567ba961c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.133243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 156/301] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/users/777e21abd83c48aaaaa03fa24eec569b => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:27.134178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648640a-0cdd-48c7-8154-da1b21cc97c4 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.138541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530047-9b65-45de-a9d5-1cc567ba961c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.158626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.243717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648640a-0cdd-48c7-8154-da1b21cc97c4 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.246763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530047-9b65-45de-a9d5-1cc567ba961c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.271471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.280846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ffca5-a5bc-4557-adad-286968f628b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.281467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d0f0-1748-4174-a940-1a204d18e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.281702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ffca5-a5bc-4557-adad-286968f628b1 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.287116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ffca5-a5bc-4557-adad-286968f628b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.287116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ffca5-a5bc-4557-adad-286968f628b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.287326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d0f0-1748-4174-a940-1a204d18e7ac None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.287326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d0f0-1748-4174-a940-1a204d18e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.287326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d0f0-1748-4174-a940-1a204d18e7ac None admin] PATH_INFO: `/v3/system/users/777e21abd83c48aaaaa03fa24eec569b/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.287326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13d0f0-1748-4174-a940-1a204d18e7ac None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=777e21abd83c48aaaaa03fa24eec569b, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.287326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13d0f0-1748-4174-a940-1a204d18e7ac None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.294843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ffca5-a5bc-4557-adad-286968f628b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-b09ffca5-a5bc-4557-adad-286968f628b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:27.303897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:27.304944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:27.305776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 146/302] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:27.307060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4fad2-e56e-49c2-8890-84b34ed78252 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.307060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4fad2-e56e-49c2-8890-84b34ed78252 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.307380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4fad2-e56e-49c2-8890-84b34ed78252 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.309056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 147/303] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:27.314829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2141-7cca-4cd6-896b-bd47a7a657ba None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.315127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2141-7cca-4cd6-896b-bd47a7a657ba None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.315410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2141-7cca-4cd6-896b-bd47a7a657ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.333523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-6fbe2141-7cca-4cd6-896b-bd47a7a657ba None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:27.334731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6fbe2141-7cca-4cd6-896b-bd47a7a657ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.417900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 148/304] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:27.418798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe2141-7cca-4cd6-896b-bd47a7a657ba None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.436198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 157/305] 10.222.0.93 () {58 vars in 1334 bytes} [Thu May 26 16:42:27 2022] PUT /identity/v3/system/users/777e21abd83c48aaaaa03fa24eec569b/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:27.443578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d0f0-1748-4174-a940-1a204d18e7ac None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.541450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.547378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe2141-7cca-4cd6-896b-bd47a7a657ba None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.561590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d0f0-1748-4174-a940-1a204d18e7ac None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.569902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.595317 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bc241-54a6-4633-9905-a061e974d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.596520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bc241-54a6-4633-9905-a061e974d9ba None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.596953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bc241-54a6-4633-9905-a061e974d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.597401 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bc241-54a6-4633-9905-a061e974d9ba None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.598324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bc241-54a6-4633-9905-a061e974d9ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:27.598796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bc241-54a6-4633-9905-a061e974d9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.599762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565d44-0f19-4050-b475-b3f1fdc944f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.600592 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565d44-0f19-4050-b475-b3f1fdc944f5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.600734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bc241-54a6-4633-9905-a061e974d9ba None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.600904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565d44-0f19-4050-b475-b3f1fdc944f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.601184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565d44-0f19-4050-b475-b3f1fdc944f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.602416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45565d44-0f19-4050-b475-b3f1fdc944f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.603905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45565d44-0f19-4050-b475-b3f1fdc944f5 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.605685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 158/306] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:27.607120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420a47f-3109-439b-b58e-04eab9a73c17 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.607408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420a47f-3109-439b-b58e-04eab9a73c17 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.607712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420a47f-3109-439b-b58e-04eab9a73c17 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.609224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 159/307] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:27.611181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420a47f-3109-439b-b58e-04eab9a73c17 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.614515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 149/308] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:27.615875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43b63-c6bf-4188-8ba9-8dc89f3800e2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.616184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43b63-c6bf-4188-8ba9-8dc89f3800e2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.616443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43b63-c6bf-4188-8ba9-8dc89f3800e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.635913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-36c43b63-c6bf-4188-8ba9-8dc89f3800e2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:27.639334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-36c43b63-c6bf-4188-8ba9-8dc89f3800e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.719071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 150/309] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:27.719845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c43b63-c6bf-4188-8ba9-8dc89f3800e2 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.742207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420a47f-3109-439b-b58e-04eab9a73c17 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.780826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db5984-d0dd-456b-b918-6f2ac345fd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.781786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db5984-d0dd-456b-b918-6f2ac345fd0a None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.782324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db5984-d0dd-456b-b918-6f2ac345fd0a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.782780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db5984-d0dd-456b-b918-6f2ac345fd0a None admin] PATH_INFO: `/v3/groups` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.783685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db5984-d0dd-456b-b918-6f2ac345fd0a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.785318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db5984-d0dd-456b-b918-6f2ac345fd0a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.831848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c43b63-c6bf-4188-8ba9-8dc89f3800e2 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.841700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.867634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0de4cd-babe-43fa-abb2-bb56aab7b0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.868494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0de4cd-babe-43fa-abb2-bb56aab7b0f4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.868772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0de4cd-babe-43fa-abb2-bb56aab7b0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.869038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0de4cd-babe-43fa-abb2-bb56aab7b0f4 None admin] PATH_INFO: `/v3/users/9decfc96b5e4432a96afd702c81fbd6e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.882461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0de4cd-babe-43fa-abb2-bb56aab7b0f4 None admin] RBAC: Authorizing `identity:get_user(user_id=9decfc96b5e4432a96afd702c81fbd6e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.883950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0de4cd-babe-43fa-abb2-bb56aab7b0f4 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.885680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 151/310] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/users/9decfc96b5e4432a96afd702c81fbd6e => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:27.892229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0de4cd-babe-43fa-abb2-bb56aab7b0f4 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.899291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 160/311] 10.222.0.93 () {60 vars in 1134 bytes} [Thu May 26 16:42:27 2022] POST /identity/v3/groups => generated 229 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:27.900884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db5984-d0dd-456b-b918-6f2ac345fd0a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.934633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:28.018564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0de4cd-babe-43fa-abb2-bb56aab7b0f4 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:28.049567 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db5984-d0dd-456b-b918-6f2ac345fd0a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:28.056369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e76d66-c9ee-4828-a906-9cb77ad66197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.057179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e76d66-c9ee-4828-a906-9cb77ad66197 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.057459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e76d66-c9ee-4828-a906-9cb77ad66197 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.057732 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e76d66-c9ee-4828-a906-9cb77ad66197 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.070760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e76d66-c9ee-4828-a906-9cb77ad66197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-72e76d66-c9ee-4828-a906-9cb77ad66197 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:28.086089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:28.090663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 152/312] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:28.096393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e76d66-c9ee-4828-a906-9cb77ad66197 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:28.103178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7cb2a-82b9-4515-a067-bc4223c3fee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.103895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7cb2a-82b9-4515-a067-bc4223c3fee7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.104178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7cb2a-82b9-4515-a067-bc4223c3fee7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.104455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7cb2a-82b9-4515-a067-bc4223c3fee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.106033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7cb2a-82b9-4515-a067-bc4223c3fee7 None admin] RBAC: Adding query filter params (role.id=30fcc9db6fb54018807b35bc5f6ff66f, user.id=9decfc96b5e4432a96afd702c81fbd6e, scope.system=all) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:28.106353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7cb2a-82b9-4515-a067-bc4223c3fee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:28.108498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7cb2a-82b9-4515-a067-bc4223c3fee7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:28.117102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 161/313] 10.222.0.93 () {56 vars in 1308 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/role_assignments?user.id=9decfc96b5e4432a96afd702c81fbd6e&scope.system=all&role.id=30fcc9db6fb54018807b35bc5f6ff66f => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:28.133092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:28.228478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e76d66-c9ee-4828-a906-9cb77ad66197 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:28.269755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8496-ce63-4e43-aa27-82b28fbbcf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.270787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8496-ce63-4e43-aa27-82b28fbbcf3e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.271273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8496-ce63-4e43-aa27-82b28fbbcf3e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.271772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8496-ce63-4e43-aa27-82b28fbbcf3e None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.272756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba8496-ce63-4e43-aa27-82b28fbbcf3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:28.273319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba8496-ce63-4e43-aa27-82b28fbbcf3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:28.275044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba8496-ce63-4e43-aa27-82b28fbbcf3e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:28.285317 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 153/314] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:28.291594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7cb2a-82b9-4515-a067-bc4223c3fee7 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:28.375668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:28.407098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7cb2a-82b9-4515-a067-bc4223c3fee7 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:28.442598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777373c-42b2-48e2-a344-dd9c35359b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.443476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777373c-42b2-48e2-a344-dd9c35359b39 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.443783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777373c-42b2-48e2-a344-dd9c35359b39 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.444056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777373c-42b2-48e2-a344-dd9c35359b39 None admin] PATH_INFO: `/v3/users/42a9b35c72b542f1bde65a7f02d7e168` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.445255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777373c-42b2-48e2-a344-dd9c35359b39 None admin] RBAC: Authorizing `identity:get_user(user_id=42a9b35c72b542f1bde65a7f02d7e168)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:28.446698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777373c-42b2-48e2-a344-dd9c35359b39 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:28.448711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 162/315] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:28 2022] GET /identity/v3/users/42a9b35c72b542f1bde65a7f02d7e168 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:28.454268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8496-ce63-4e43-aa27-82b28fbbcf3e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:28.547862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:28.566946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8496-ce63-4e43-aa27-82b28fbbcf3e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:28.605882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201249-2ed2-420e-92c4-19372cf96400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.606866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201249-2ed2-420e-92c4-19372cf96400 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.607379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201249-2ed2-420e-92c4-19372cf96400 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.607863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201249-2ed2-420e-92c4-19372cf96400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.681662 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201249-2ed2-420e-92c4-19372cf96400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:28.683143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201249-2ed2-420e-92c4-19372cf96400 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:28.772941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:28.786336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 154/316] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:42:28.791866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777373c-42b2-48e2-a344-dd9c35359b39 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:28.897029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777373c-42b2-48e2-a344-dd9c35359b39 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:28.933214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02de76-55b1-4f64-9a44-3c9738246ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.934124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02de76-55b1-4f64-9a44-3c9738246ef0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.934403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02de76-55b1-4f64-9a44-3c9738246ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.934692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02de76-55b1-4f64-9a44-3c9738246ef0 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.935922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02de76-55b1-4f64-9a44-3c9738246ef0 None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:28.937401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02de76-55b1-4f64-9a44-3c9738246ef0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:28.939369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 163/317] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:28 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:28.945311 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201249-2ed2-420e-92c4-19372cf96400 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:29.052516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201249-2ed2-420e-92c4-19372cf96400 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:29.088566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa007f-c922-4feb-a6b2-e30c21e441db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:29.089215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa007f-c922-4feb-a6b2-e30c21e441db None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.089556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa007f-c922-4feb-a6b2-e30c21e441db None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.089855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa007f-c922-4feb-a6b2-e30c21e441db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.090743 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa007f-c922-4feb-a6b2-e30c21e441db None admin] RBAC: Adding query filter params (role.id=30fcc9db6fb54018807b35bc5f6ff66f, scope.project.id=00f7b7c66c944591aeea55c51b88d348, user.id=42a9b35c72b542f1bde65a7f02d7e168) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:29.091059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa007f-c922-4feb-a6b2-e30c21e441db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:29.095229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa007f-c922-4feb-a6b2-e30c21e441db None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:29.102034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 155/318] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:28 2022] GET /identity/v3/role_assignments?user.id=42a9b35c72b542f1bde65a7f02d7e168&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=30fcc9db6fb54018807b35bc5f6ff66f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:29.718533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9db00-2232-43ea-bbc7-6475b7f0a911 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.718836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9db00-2232-43ea-bbc7-6475b7f0a911 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.719088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9db00-2232-43ea-bbc7-6475b7f0a911 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.720671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 164/319] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:29.725632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1fd0-c137-482a-ac01-a13a22b077fa None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.725929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1fd0-c137-482a-ac01-a13a22b077fa None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.726207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1fd0-c137-482a-ac01-a13a22b077fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.743084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-744a1fd0-c137-482a-ac01-a13a22b077fa None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:29.744312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-744a1fd0-c137-482a-ac01-a13a22b077fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:29.793415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:29.813619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 156/320] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:29.837009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9db00-2232-43ea-bbc7-6475b7f0a911 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:29.849705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.037989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9db00-2232-43ea-bbc7-6475b7f0a911 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.071856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0b655-5f7a-40f9-96a0-8607077ba37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.072658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0b655-5f7a-40f9-96a0-8607077ba37a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.072939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0b655-5f7a-40f9-96a0-8607077ba37a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.073402 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0b655-5f7a-40f9-96a0-8607077ba37a None admin] PATH_INFO: `/v3/roles/member` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.084410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0b655-5f7a-40f9-96a0-8607077ba37a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-dce0b655-5f7a-40f9-96a0-8607077ba37a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:30.092325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:30.093280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:30.094097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:30.095693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 165/321] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:30.099276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1fd0-c137-482a-ac01-a13a22b077fa None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.208320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1fd0-c137-482a-ac01-a13a22b077fa None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.243225 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150de5b-dee4-49d6-bcf4-582a97bbe6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.243920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150de5b-dee4-49d6-bcf4-582a97bbe6da None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.244203 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150de5b-dee4-49d6-bcf4-582a97bbe6da None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.244478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150de5b-dee4-49d6-bcf4-582a97bbe6da None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.245230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150de5b-dee4-49d6-bcf4-582a97bbe6da None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:30.245537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150de5b-dee4-49d6-bcf4-582a97bbe6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:30.246935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150de5b-dee4-49d6-bcf4-582a97bbe6da None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:30.257491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 157/322] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:30.262997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0b655-5f7a-40f9-96a0-8607077ba37a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.315274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b4dc-13bb-4003-a4cc-929959430036 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.315485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b4dc-13bb-4003-a4cc-929959430036 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.315793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b4dc-13bb-4003-a4cc-929959430036 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.317336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 158/323] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:30.322136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d38075-b3e6-4bc4-8804-5bb472593b60 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.322430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d38075-b3e6-4bc4-8804-5bb472593b60 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.322710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d38075-b3e6-4bc4-8804-5bb472593b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.335032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.340635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b1d38075-b3e6-4bc4-8804-5bb472593b60 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:30.342076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b1d38075-b3e6-4bc4-8804-5bb472593b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:30.372351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0b655-5f7a-40f9-96a0-8607077ba37a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.387496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.412773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6aca-a596-4d6f-a845-39fcee7f4c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.413690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6aca-a596-4d6f-a845-39fcee7f4c22 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.413920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6aca-a596-4d6f-a845-39fcee7f4c22 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.414295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6aca-a596-4d6f-a845-39fcee7f4c22 None admin] PATH_INFO: `/v3/users/777e21abd83c48aaaaa03fa24eec569b` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.428285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed6aca-a596-4d6f-a845-39fcee7f4c22 None admin] RBAC: Authorizing `identity:get_user(user_id=777e21abd83c48aaaaa03fa24eec569b)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:30.428447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 159/324] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:30.428528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed6aca-a596-4d6f-a845-39fcee7f4c22 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:30.428528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 166/325] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:30 2022] GET /identity/v3/users/777e21abd83c48aaaaa03fa24eec569b => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:30.428650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d38075-b3e6-4bc4-8804-5bb472593b60 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.440001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6aca-a596-4d6f-a845-39fcee7f4c22 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.525342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d38075-b3e6-4bc4-8804-5bb472593b60 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.538302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6aca-a596-4d6f-a845-39fcee7f4c22 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.559552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9416d-4cb6-4620-9c51-9700287994ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.560224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9416d-4cb6-4620-9c51-9700287994ab None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.560507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9416d-4cb6-4620-9c51-9700287994ab None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.560782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9416d-4cb6-4620-9c51-9700287994ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.562189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9416d-4cb6-4620-9c51-9700287994ab None admin] RBAC: Adding query filter params (role.id=9921f4d7024b4fec93767ff982451ef7, user.id=777e21abd83c48aaaaa03fa24eec569b, scope.system=all) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:30.562506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9416d-4cb6-4620-9c51-9700287994ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:30.564012 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9416d-4cb6-4620-9c51-9700287994ab None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:30.572516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce5b6e-c376-422d-b86d-59e46a8eb620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.573235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5b6e-c376-422d-b86d-59e46a8eb620 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.573514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5b6e-c376-422d-b86d-59e46a8eb620 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.573785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5b6e-c376-422d-b86d-59e46a8eb620 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.574926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce5b6e-c376-422d-b86d-59e46a8eb620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:30.576010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 160/326] 10.222.0.93 () {56 vars in 1308 bytes} [Thu May 26 16:42:30 2022] GET /identity/v3/role_assignments?user.id=777e21abd83c48aaaaa03fa24eec569b&scope.system=all&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 510 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:30.576430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce5b6e-c376-422d-b86d-59e46a8eb620 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:30.577331 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1168db-f5dc-4c8b-b595-829aa2616f15 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.577626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1168db-f5dc-4c8b-b595-829aa2616f15 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.577902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1168db-f5dc-4c8b-b595-829aa2616f15 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.579002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 167/327] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:30.580181 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 161/328] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:30.585056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce5b6e-c376-422d-b86d-59e46a8eb620 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.587116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088928-5ce1-4331-8b5a-f9aeec15a36c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.587394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088928-5ce1-4331-8b5a-f9aeec15a36c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.587711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088928-5ce1-4331-8b5a-f9aeec15a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.590507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.607410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-46088928-5ce1-4331-8b5a-f9aeec15a36c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:30.609190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-46088928-5ce1-4331-8b5a-f9aeec15a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:30.638872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.686001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 162/329] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:30.708161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088928-5ce1-4331-8b5a-f9aeec15a36c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.717760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce5b6e-c376-422d-b86d-59e46a8eb620 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.757945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887608c8-70f3-40cd-a427-9f609306601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.758608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887608c8-70f3-40cd-a427-9f609306601c None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.758888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887608c8-70f3-40cd-a427-9f609306601c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.759164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887608c8-70f3-40cd-a427-9f609306601c None admin] PATH_INFO: `/v3/groups` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.759900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887608c8-70f3-40cd-a427-9f609306601c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:30.761369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887608c8-70f3-40cd-a427-9f609306601c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:30.815400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088928-5ce1-4331-8b5a-f9aeec15a36c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.856139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a822-a0e1-41ed-b660-185f18c995fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.856901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a822-a0e1-41ed-b660-185f18c995fc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.857178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a822-a0e1-41ed-b660-185f18c995fc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.857449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a822-a0e1-41ed-b660-185f18c995fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.868110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a822-a0e1-41ed-b660-185f18c995fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-d750a822-a0e1-41ed-b660-185f18c995fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:30.875767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:30.876936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:30.877742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 163/330] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:30.884068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a822-a0e1-41ed-b660-185f18c995fc None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.916182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 168/331] 10.222.0.93 () {60 vars in 1134 bytes} [Thu May 26 16:42:30 2022] POST /identity/v3/groups => generated 226 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:30.916967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.989679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a822-a0e1-41ed-b660-185f18c995fc None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.025270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415e524-75b9-4a66-862f-cd0170f606e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.025997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415e524-75b9-4a66-862f-cd0170f606e5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.026284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415e524-75b9-4a66-862f-cd0170f606e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.026568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415e524-75b9-4a66-862f-cd0170f606e5 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.027372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415e524-75b9-4a66-862f-cd0170f606e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:31.027714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415e524-75b9-4a66-862f-cd0170f606e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.029137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415e524-75b9-4a66-862f-cd0170f606e5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.038956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 164/332] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:31.044852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887608c8-70f3-40cd-a427-9f609306601c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:31.112475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:31.152182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887608c8-70f3-40cd-a427-9f609306601c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.191729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bc7ae-ce78-4e8a-9c0c-54e56cd76bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.192614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bc7ae-ce78-4e8a-9c0c-54e56cd76bf5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.192895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bc7ae-ce78-4e8a-9c0c-54e56cd76bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.193167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bc7ae-ce78-4e8a-9c0c-54e56cd76bf5 None admin] PATH_INFO: `/v3/users/9decfc96b5e4432a96afd702c81fbd6e` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.194376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bc7ae-ce78-4e8a-9c0c-54e56cd76bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=9decfc96b5e4432a96afd702c81fbd6e)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.195914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bc7ae-ce78-4e8a-9c0c-54e56cd76bf5 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.197544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 169/333] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:31 2022] GET /identity/v3/users/9decfc96b5e4432a96afd702c81fbd6e => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:31.204211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415e524-75b9-4a66-862f-cd0170f606e5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:31.298114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:31.313790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415e524-75b9-4a66-862f-cd0170f606e5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.351651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d036f8e-0fcf-4ca7-8dc3-197952d0b3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.352521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d036f8e-0fcf-4ca7-8dc3-197952d0b3cc None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.352806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d036f8e-0fcf-4ca7-8dc3-197952d0b3cc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.353078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d036f8e-0fcf-4ca7-8dc3-197952d0b3cc None admin] PATH_INFO: `/v3/system/users/9decfc96b5e4432a96afd702c81fbd6e/roles/30fcc9db6fb54018807b35bc5f6ff66f` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.354617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d036f8e-0fcf-4ca7-8dc3-197952d0b3cc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9decfc96b5e4432a96afd702c81fbd6e, role_id=30fcc9db6fb54018807b35bc5f6ff66f)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.356209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d036f8e-0fcf-4ca7-8dc3-197952d0b3cc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.502680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 165/334] 10.222.0.93 () {58 vars in 1334 bytes} [Thu May 26 16:42:31 2022] PUT /identity/v3/system/users/9decfc96b5e4432a96afd702c81fbd6e/roles/30fcc9db6fb54018807b35bc5f6ff66f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:33.460792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629345-bd22-40f9-9877-092b80204bef None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.461399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629345-bd22-40f9-9877-092b80204bef None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.461399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629345-bd22-40f9-9877-092b80204bef None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.462997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 170/335] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:33.469431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f6b0-d9f9-4063-9e4e-18af6061af60 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.469930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f6b0-d9f9-4063-9e4e-18af6061af60 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.470013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f6b0-d9f9-4063-9e4e-18af6061af60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.496625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-4519f6b0-d9f9-4063-9e4e-18af6061af60 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:33.497822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4519f6b0-d9f9-4063-9e4e-18af6061af60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:33.583126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 166/336] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:33.623430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629345-bd22-40f9-9877-092b80204bef None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:33.764538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629345-bd22-40f9-9877-092b80204bef None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:33.805454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:33.810390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e9f52-ffdd-4d4c-9c33-6c80e49a3d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:33.811306 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e9f52-ffdd-4d4c-9c33-6c80e49a3d96 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.811608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e9f52-ffdd-4d4c-9c33-6c80e49a3d96 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.811878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e9f52-ffdd-4d4c-9c33-6c80e49a3d96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.828648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e9f52-ffdd-4d4c-9c33-6c80e49a3d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-e16e9f52-ffdd-4d4c-9c33-6c80e49a3d96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:33.836684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:33.837779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:33.839080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 171/337] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:33.846992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519f6b0-d9f9-4063-9e4e-18af6061af60 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.073857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:34.100555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67934a5b-5a9d-436a-9d31-338c6cde7e23 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.100896 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67934a5b-5a9d-436a-9d31-338c6cde7e23 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.101102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67934a5b-5a9d-436a-9d31-338c6cde7e23 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.102733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 172/338] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:34.108496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24837aa-7004-427e-b026-bf0f5d034214 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.108790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24837aa-7004-427e-b026-bf0f5d034214 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.109066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24837aa-7004-427e-b026-bf0f5d034214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.115882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519f6b0-d9f9-4063-9e4e-18af6061af60 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.145868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-a24837aa-7004-427e-b026-bf0f5d034214 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:34.147118 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a24837aa-7004-427e-b026-bf0f5d034214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.195781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332ca8e-7e79-4329-b49f-c3e4dae244d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.196459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332ca8e-7e79-4329-b49f-c3e4dae244d4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.196743 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332ca8e-7e79-4329-b49f-c3e4dae244d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.197018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332ca8e-7e79-4329-b49f-c3e4dae244d4 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.197776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332ca8e-7e79-4329-b49f-c3e4dae244d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:34.198086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332ca8e-7e79-4329-b49f-c3e4dae244d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.200663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332ca8e-7e79-4329-b49f-c3e4dae244d4 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.223187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 167/339] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:34.233669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332ca8e-7e79-4329-b49f-c3e4dae244d4 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.283008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 173/340] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:34.284468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d3ef0-f4dd-401d-9f41-b9c176686dc6 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.284714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d3ef0-f4dd-401d-9f41-b9c176686dc6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.284986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d3ef0-f4dd-401d-9f41-b9c176686dc6 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.286303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 174/341] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:34.292570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0061b-1c20-4c33-9ce0-0ac51c71db45 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.292864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0061b-1c20-4c33-9ce0-0ac51c71db45 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.293130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0061b-1c20-4c33-9ce0-0ac51c71db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.314438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-80d0061b-1c20-4c33-9ce0-0ac51c71db45 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:34.317191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-80d0061b-1c20-4c33-9ce0-0ac51c71db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.394797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 175/342] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:34.395729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0061b-1c20-4c33-9ce0-0ac51c71db45 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.481634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:34.507594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332ca8e-7e79-4329-b49f-c3e4dae244d4 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.603308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0061b-1c20-4c33-9ce0-0ac51c71db45 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.617518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fc89b-a67c-405a-baba-c9e4858c2fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.618202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fc89b-a67c-405a-baba-c9e4858c2fa7 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.618478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fc89b-a67c-405a-baba-c9e4858c2fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.618746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fc89b-a67c-405a-baba-c9e4858c2fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.643997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:34.678461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d92b4-88ac-4204-8fc6-d6d46ef40967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.679189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d92b4-88ac-4204-8fc6-d6d46ef40967 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.679468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d92b4-88ac-4204-8fc6-d6d46ef40967 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.679769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d92b4-88ac-4204-8fc6-d6d46ef40967 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.707868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d92b4-88ac-4204-8fc6-d6d46ef40967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-f56d92b4-88ac-4204-8fc6-d6d46ef40967 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:34.715548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:34.716760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:34.717645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:34.729416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 176/343] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:34.730341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d92b4-88ac-4204-8fc6-d6d46ef40967 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.762680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fc89b-a67c-405a-baba-c9e4858c2fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.765329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fc89b-a67c-405a-baba-c9e4858c2fa7 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.857710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d92b4-88ac-4204-8fc6-d6d46ef40967 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.874558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:34.874736 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 168/344] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:42:34.874736 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fc89b-a67c-405a-baba-c9e4858c2fa7 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.895278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd294f-c929-4ad5-be67-aa3f3a7e8aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.896882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd294f-c929-4ad5-be67-aa3f3a7e8aa7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.896882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd294f-c929-4ad5-be67-aa3f3a7e8aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.896882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd294f-c929-4ad5-be67-aa3f3a7e8aa7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.908809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd294f-c929-4ad5-be67-aa3f3a7e8aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-efcd294f-c929-4ad5-be67-aa3f3a7e8aa7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:34.921152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:34.923641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:34.925805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 177/345] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:34.931670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbabc-035f-426c-a07e-02ff017e5264 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.931670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbabc-035f-426c-a07e-02ff017e5264 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.931670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbabc-035f-426c-a07e-02ff017e5264 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.933047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 178/346] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:34.936081 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:34.937738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbabc-035f-426c-a07e-02ff017e5264 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.996170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fc89b-a67c-405a-baba-c9e4858c2fa7 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.038479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd483-1762-4018-b431-a14f7b7775b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.039157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd483-1762-4018-b431-a14f7b7775b7 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.039439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd483-1762-4018-b431-a14f7b7775b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.039899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd483-1762-4018-b431-a14f7b7775b7 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.040671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd483-1762-4018-b431-a14f7b7775b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:35.040981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd483-1762-4018-b431-a14f7b7775b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.042506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd483-1762-4018-b431-a14f7b7775b7 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.053626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 169/347] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:35.054978 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436ee0-5aa5-47c4-8c59-4bf73fc3dc9c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.055249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436ee0-5aa5-47c4-8c59-4bf73fc3dc9c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.055525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436ee0-5aa5-47c4-8c59-4bf73fc3dc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.073793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbabc-035f-426c-a07e-02ff017e5264 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.080496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-86436ee0-5aa5-47c4-8c59-4bf73fc3dc9c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:35.081730 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-86436ee0-5aa5-47c4-8c59-4bf73fc3dc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.116536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2525257-9db0-4589-925d-8b69339044de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.117575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2525257-9db0-4589-925d-8b69339044de None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.117861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2525257-9db0-4589-925d-8b69339044de None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.118132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2525257-9db0-4589-925d-8b69339044de None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.119452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2525257-9db0-4589-925d-8b69339044de None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.121140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2525257-9db0-4589-925d-8b69339044de None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.122967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 179/348] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:34 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:35.124409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2525257-9db0-4589-925d-8b69339044de None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.161853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 170/349] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:35.162934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86436ee0-5aa5-47c4-8c59-4bf73fc3dc9c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.172195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:35.213012 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:35.238164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2525257-9db0-4589-925d-8b69339044de None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.277611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48893f2-023a-4064-8339-227b30cc25cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.278545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48893f2-023a-4064-8339-227b30cc25cd None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.279103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48893f2-023a-4064-8339-227b30cc25cd None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.279627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48893f2-023a-4064-8339-227b30cc25cd None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.281156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48893f2-023a-4064-8339-227b30cc25cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:35.281604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48893f2-023a-4064-8339-227b30cc25cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.283236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48893f2-023a-4064-8339-227b30cc25cd None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.294228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 180/350] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:35.296085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48893f2-023a-4064-8339-227b30cc25cd None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.299713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86436ee0-5aa5-47c4-8c59-4bf73fc3dc9c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.349176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044272d-32fd-4e33-8799-d4c870e471c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.350003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044272d-32fd-4e33-8799-d4c870e471c2 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.350387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044272d-32fd-4e33-8799-d4c870e471c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.350766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044272d-32fd-4e33-8799-d4c870e471c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.423357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48893f2-023a-4064-8339-227b30cc25cd None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.424998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:35.448523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044272d-32fd-4e33-8799-d4c870e471c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.450044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044272d-32fd-4e33-8799-d4c870e471c2 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.472380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c568cb4-6037-4033-9deb-4c74cd33b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.473914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c568cb4-6037-4033-9deb-4c74cd33b21d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.474448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c568cb4-6037-4033-9deb-4c74cd33b21d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.474933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c568cb4-6037-4033-9deb-4c74cd33b21d None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.485141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c568cb4-6037-4033-9deb-4c74cd33b21d None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.487911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c568cb4-6037-4033-9deb-4c74cd33b21d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.489823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:35.490042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 181/351] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:35.492400 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c568cb4-6037-4033-9deb-4c74cd33b21d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.595925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 171/352] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:35.597343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60ec90-48af-46df-b10e-fd096cd3021d None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.597638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60ec90-48af-46df-b10e-fd096cd3021d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.597912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60ec90-48af-46df-b10e-fd096cd3021d None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.599281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 172/353] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:35.600061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60ec90-48af-46df-b10e-fd096cd3021d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.620647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c568cb4-6037-4033-9deb-4c74cd33b21d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.669563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7c8b-6438-49d2-90ed-6e654a5b8956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.671063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7c8b-6438-49d2-90ed-6e654a5b8956 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.671355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7c8b-6438-49d2-90ed-6e654a5b8956 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.671657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7c8b-6438-49d2-90ed-6e654a5b8956 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.688316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b7c8b-6438-49d2-90ed-6e654a5b8956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-c93b7c8b-6438-49d2-90ed-6e654a5b8956 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:35.697354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:35.698299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:35.699114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 182/354] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:35.699883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7c8b-6438-49d2-90ed-6e654a5b8956 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.737147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:35.741933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60ec90-48af-46df-b10e-fd096cd3021d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.776157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:35.784399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581f13a-4166-4166-8830-b1709b3d7021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.785040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581f13a-4166-4166-8830-b1709b3d7021 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.785318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581f13a-4166-4166-8830-b1709b3d7021 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.788353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581f13a-4166-4166-8830-b1709b3d7021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.821635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7c8b-6438-49d2-90ed-6e654a5b8956 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.863661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f63bc-7540-42b1-8e38-d154089ab336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.865297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f63bc-7540-42b1-8e38-d154089ab336 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.865297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f63bc-7540-42b1-8e38-d154089ab336 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.865297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f63bc-7540-42b1-8e38-d154089ab336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.865777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f63bc-7540-42b1-8e38-d154089ab336 None admin] RBAC: Adding query filter params (group.id=da2229df64204c14802e836e7773f507, role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=31d62d27680a4a5c899151375f3273a4) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:35.866088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f63bc-7540-42b1-8e38-d154089ab336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.867532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f63bc-7540-42b1-8e38-d154089ab336 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.872723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581f13a-4166-4166-8830-b1709b3d7021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.873912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 183/355] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/role_assignments?group.id=da2229df64204c14802e836e7773f507&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:35.874335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581f13a-4166-4166-8830-b1709b3d7021 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.875162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c0c1e-7b08-4a43-8396-974b9dfbebe3 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.875449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c0c1e-7b08-4a43-8396-974b9dfbebe3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.875791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c0c1e-7b08-4a43-8396-974b9dfbebe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.895473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-346c0c1e-7b08-4a43-8396-974b9dfbebe3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:35.896853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-346c0c1e-7b08-4a43-8396-974b9dfbebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.997779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 184/356] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:35.999070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c0c1e-7b08-4a43-8396-974b9dfbebe3 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.031369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.037099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 173/357] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:36.038255 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9751-3fe3-4f63-92de-0dd3784811cf None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.038543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9751-3fe3-4f63-92de-0dd3784811cf None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.038822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9751-3fe3-4f63-92de-0dd3784811cf None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.040403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 174/358] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:36.040992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9751-3fe3-4f63-92de-0dd3784811cf None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.085479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.137700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c0c1e-7b08-4a43-8396-974b9dfbebe3 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.175000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9751-3fe3-4f63-92de-0dd3784811cf None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.182832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f4297-5f21-4f48-b686-bcc00f5f7500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.183895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f4297-5f21-4f48-b686-bcc00f5f7500 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.184284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f4297-5f21-4f48-b686-bcc00f5f7500 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.184665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f4297-5f21-4f48-b686-bcc00f5f7500 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.186117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f4297-5f21-4f48-b686-bcc00f5f7500 None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.187715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f4297-5f21-4f48-b686-bcc00f5f7500 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.189724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 185/359] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:36.192825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f4297-5f21-4f48-b686-bcc00f5f7500 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.221116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72103da5-0d3a-4e81-9236-c4cee737cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.222168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72103da5-0d3a-4e81-9236-c4cee737cc46 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.222660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72103da5-0d3a-4e81-9236-c4cee737cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.223137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72103da5-0d3a-4e81-9236-c4cee737cc46 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.224129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72103da5-0d3a-4e81-9236-c4cee737cc46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:36.224436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72103da5-0d3a-4e81-9236-c4cee737cc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.227172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72103da5-0d3a-4e81-9236-c4cee737cc46 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.238757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 175/360] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:36.240080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779f1ba-1611-4b0c-b2d3-d23ebae0e1da None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.240368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779f1ba-1611-4b0c-b2d3-d23ebae0e1da None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.240639 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779f1ba-1611-4b0c-b2d3-d23ebae0e1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.263387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d779f1ba-1611-4b0c-b2d3-d23ebae0e1da None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:36.264881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d779f1ba-1611-4b0c-b2d3-d23ebae0e1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.307179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.325790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f4297-5f21-4f48-b686-bcc00f5f7500 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.352692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 176/361] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:36.353753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779f1ba-1611-4b0c-b2d3-d23ebae0e1da None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.369246 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ee7f8-4fb7-4003-80ac-599e1cf1000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.370057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee7f8-4fb7-4003-80ac-599e1cf1000d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.370335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee7f8-4fb7-4003-80ac-599e1cf1000d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.370654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee7f8-4fb7-4003-80ac-599e1cf1000d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.383000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ee7f8-4fb7-4003-80ac-599e1cf1000d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:36.383680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-4d8ee7f8-4fb7-4003-80ac-599e1cf1000d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:36.392165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:36.393130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:36.393973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 186/362] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:36.394661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ee7f8-4fb7-4003-80ac-599e1cf1000d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.470863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779f1ba-1611-4b0c-b2d3-d23ebae0e1da None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.507678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ee7f8-4fb7-4003-80ac-599e1cf1000d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.511173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541acd6-b462-4644-a3b6-12da2aca2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.512392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541acd6-b462-4644-a3b6-12da2aca2082 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.512891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541acd6-b462-4644-a3b6-12da2aca2082 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.513168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541acd6-b462-4644-a3b6-12da2aca2082 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.515753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541acd6-b462-4644-a3b6-12da2aca2082 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.517190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541acd6-b462-4644-a3b6-12da2aca2082 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.519445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 177/363] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:36.520108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541acd6-b462-4644-a3b6-12da2aca2082 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.567538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03616983-5adb-441a-8c88-aa7710d7aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.568428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03616983-5adb-441a-8c88-aa7710d7aed6 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.568708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03616983-5adb-441a-8c88-aa7710d7aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.568982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03616983-5adb-441a-8c88-aa7710d7aed6 None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.572148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03616983-5adb-441a-8c88-aa7710d7aed6 None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.573188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03616983-5adb-441a-8c88-aa7710d7aed6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.574826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 187/364] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:36.578844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03616983-5adb-441a-8c88-aa7710d7aed6 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.606303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.690931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.704344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541acd6-b462-4644-a3b6-12da2aca2082 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.724781 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03616983-5adb-441a-8c88-aa7710d7aed6 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.761350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8557d0-2f09-4fb7-a861-f54c70049e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.762341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8557d0-2f09-4fb7-a861-f54c70049e7f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.762696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8557d0-2f09-4fb7-a861-f54c70049e7f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.763317 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8557d0-2f09-4fb7-a861-f54c70049e7f None admin] PATH_INFO: `/v3/users/9decfc96b5e4432a96afd702c81fbd6e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.764427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8557d0-2f09-4fb7-a861-f54c70049e7f None admin] RBAC: Authorizing `identity:get_user(user_id=9decfc96b5e4432a96afd702c81fbd6e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.766923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8557d0-2f09-4fb7-a861-f54c70049e7f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.771860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 178/365] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/users/9decfc96b5e4432a96afd702c81fbd6e => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:36.771860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8557d0-2f09-4fb7-a861-f54c70049e7f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.788151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde0b4b-f926-4b8d-8cf9-d0c21b328422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.788953 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde0b4b-f926-4b8d-8cf9-d0c21b328422 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.789231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde0b4b-f926-4b8d-8cf9-d0c21b328422 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.789501 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde0b4b-f926-4b8d-8cf9-d0c21b328422 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.811308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde0b4b-f926-4b8d-8cf9-d0c21b328422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-edde0b4b-f926-4b8d-8cf9-d0c21b328422 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:36.821356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:36.822292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:36.823087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 188/366] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:36.823807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde0b4b-f926-4b8d-8cf9-d0c21b328422 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.918030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8557d0-2f09-4fb7-a861-f54c70049e7f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.950676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.965691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bc82e-055f-4ae0-8b4c-00839cfb41b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.966679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bc82e-055f-4ae0-8b4c-00839cfb41b2 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.977520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bc82e-055f-4ae0-8b4c-00839cfb41b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.977520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bc82e-055f-4ae0-8b4c-00839cfb41b2 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.977520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bc82e-055f-4ae0-8b4c-00839cfb41b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:36.977520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bc82e-055f-4ae0-8b4c-00839cfb41b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.977520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bc82e-055f-4ae0-8b4c-00839cfb41b2 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.987492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 179/367] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:36.987492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bc82e-055f-4ae0-8b4c-00839cfb41b2 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.996005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde0b4b-f926-4b8d-8cf9-d0c21b328422 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.034685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.043066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf6ae-36ca-4b22-a086-8a5f51b48df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.043984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf6ae-36ca-4b22-a086-8a5f51b48df8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.044428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf6ae-36ca-4b22-a086-8a5f51b48df8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.044705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf6ae-36ca-4b22-a086-8a5f51b48df8 None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.049239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf6ae-36ca-4b22-a086-8a5f51b48df8 None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.049239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf6ae-36ca-4b22-a086-8a5f51b48df8 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.049239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 189/368] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:37.049958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf6ae-36ca-4b22-a086-8a5f51b48df8 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.130734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bc82e-055f-4ae0-8b4c-00839cfb41b2 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.173314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf6ae-36ca-4b22-a086-8a5f51b48df8 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.183182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe059e4-c21a-405a-9741-18ad9624e996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.183983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe059e4-c21a-405a-9741-18ad9624e996 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.184337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe059e4-c21a-405a-9741-18ad9624e996 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.184698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe059e4-c21a-405a-9741-18ad9624e996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.185637 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe059e4-c21a-405a-9741-18ad9624e996 None admin] RBAC: Adding query filter params (group.id=da2229df64204c14802e836e7773f507, role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=00f7b7c66c944591aeea55c51b88d348) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:37.186528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe059e4-c21a-405a-9741-18ad9624e996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.188175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe059e4-c21a-405a-9741-18ad9624e996 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.195717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 180/369] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/role_assignments?group.id=da2229df64204c14802e836e7773f507&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:37.196485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe059e4-c21a-405a-9741-18ad9624e996 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.217516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba47c3c-ab18-432e-b390-31402c643fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.218464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47c3c-ab18-432e-b390-31402c643fef None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.218750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47c3c-ab18-432e-b390-31402c643fef None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.219532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47c3c-ab18-432e-b390-31402c643fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.220620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba47c3c-ab18-432e-b390-31402c643fef None admin] RBAC: Adding query filter params (role.id=30fcc9db6fb54018807b35bc5f6ff66f, user.id=9decfc96b5e4432a96afd702c81fbd6e, scope.system=all) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:37.221077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba47c3c-ab18-432e-b390-31402c643fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.222779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba47c3c-ab18-432e-b390-31402c643fef None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.240817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 190/370] 10.222.0.93 () {56 vars in 1308 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/role_assignments?user.id=9decfc96b5e4432a96afd702c81fbd6e&scope.system=all&role.id=30fcc9db6fb54018807b35bc5f6ff66f => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:37.241776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba47c3c-ab18-432e-b390-31402c643fef None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.258062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.312132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.326253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe059e4-c21a-405a-9741-18ad9624e996 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.365530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848090dc-8052-4491-b939-b948ed3b424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.366273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848090dc-8052-4491-b939-b948ed3b424c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.366557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848090dc-8052-4491-b939-b948ed3b424c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.366835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848090dc-8052-4491-b939-b948ed3b424c None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.367760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848090dc-8052-4491-b939-b948ed3b424c None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:37.368092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848090dc-8052-4491-b939-b948ed3b424c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.369534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848090dc-8052-4491-b939-b948ed3b424c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.391471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 181/371] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:37.392479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848090dc-8052-4491-b939-b948ed3b424c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.431839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba47c3c-ab18-432e-b390-31402c643fef None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.505260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c385e0-ad3e-483d-ab79-0be41a085669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.506134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c385e0-ad3e-483d-ab79-0be41a085669 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.506429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c385e0-ad3e-483d-ab79-0be41a085669 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.506709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c385e0-ad3e-483d-ab79-0be41a085669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.508948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848090dc-8052-4491-b939-b948ed3b424c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.545556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c446128-df7e-453e-90e3-6ecefa00cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.546209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446128-df7e-453e-90e3-6ecefa00cf04 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.546490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446128-df7e-453e-90e3-6ecefa00cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.546765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446128-df7e-453e-90e3-6ecefa00cf04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.547627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c446128-df7e-453e-90e3-6ecefa00cf04 None admin] RBAC: Adding query filter params (group.id=da2229df64204c14802e836e7773f507, role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=31d62d27680a4a5c899151375f3273a4) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:37.547948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c446128-df7e-453e-90e3-6ecefa00cf04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.549419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c446128-df7e-453e-90e3-6ecefa00cf04 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.556627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 182/372] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/role_assignments?group.id=da2229df64204c14802e836e7773f507&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:37.557486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c446128-df7e-453e-90e3-6ecefa00cf04 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.577208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.604872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c385e0-ad3e-483d-ab79-0be41a085669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.606428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c385e0-ad3e-483d-ab79-0be41a085669 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.616049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.681718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c446128-df7e-453e-90e3-6ecefa00cf04 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.726566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1110e25-91ea-4ba1-bf58-9a0cbf6ebee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.727333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1110e25-91ea-4ba1-bf58-9a0cbf6ebee6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.727520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1110e25-91ea-4ba1-bf58-9a0cbf6ebee6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.727859 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1110e25-91ea-4ba1-bf58-9a0cbf6ebee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.745111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 191/373] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:37.751494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c385e0-ad3e-483d-ab79-0be41a085669 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.803505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1110e25-91ea-4ba1-bf58-9a0cbf6ebee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.805003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1110e25-91ea-4ba1-bf58-9a0cbf6ebee6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.820893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.919630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 183/374] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:37.920998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c385e0-ad3e-483d-ab79-0be41a085669 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.923938 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.942568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1110e25-91ea-4ba1-bf58-9a0cbf6ebee6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.971845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1959c4-2b33-4671-adf6-7f29ed5a769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.972706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1959c4-2b33-4671-adf6-7f29ed5a769a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.972984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1959c4-2b33-4671-adf6-7f29ed5a769a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.973255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1959c4-2b33-4671-adf6-7f29ed5a769a None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.974496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1959c4-2b33-4671-adf6-7f29ed5a769a None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.976054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1959c4-2b33-4671-adf6-7f29ed5a769a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.978121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 192/375] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:37.984596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1959c4-2b33-4671-adf6-7f29ed5a769a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.101368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1959c4-2b33-4671-adf6-7f29ed5a769a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.146572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f1075-8f04-4295-a009-cf0cb058d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.147492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f1075-8f04-4295-a009-cf0cb058d81b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.147833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f1075-8f04-4295-a009-cf0cb058d81b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.148110 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f1075-8f04-4295-a009-cf0cb058d81b None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.150398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f1075-8f04-4295-a009-cf0cb058d81b None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.151863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f1075-8f04-4295-a009-cf0cb058d81b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.153704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 193/376] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:38.160818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f1075-8f04-4295-a009-cf0cb058d81b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.161558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1110e25-91ea-4ba1-bf58-9a0cbf6ebee6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.190055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.245716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.247698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f6355-797d-41bd-848b-b9cfb35fe4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.249090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f6355-797d-41bd-848b-b9cfb35fe4b5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.249377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f6355-797d-41bd-848b-b9cfb35fe4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.249650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f6355-797d-41bd-848b-b9cfb35fe4b5 None admin] PATH_INFO: `/v3/projects/a1dee3d9410543e8a4d913fcc504aee9` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.253624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f6355-797d-41bd-848b-b9cfb35fe4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=a1dee3d9410543e8a4d913fcc504aee9)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.255179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f6355-797d-41bd-848b-b9cfb35fe4b5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.257252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 184/377] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/projects/a1dee3d9410543e8a4d913fcc504aee9 => generated 344 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:38.262700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f6355-797d-41bd-848b-b9cfb35fe4b5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.372494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f1075-8f04-4295-a009-cf0cb058d81b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.440449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9f4fa-b9b6-46c6-975d-d0a9b14fa7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.441038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9f4fa-b9b6-46c6-975d-d0a9b14fa7a0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.441484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9f4fa-b9b6-46c6-975d-d0a9b14fa7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.441756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9f4fa-b9b6-46c6-975d-d0a9b14fa7a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.443212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9f4fa-b9b6-46c6-975d-d0a9b14fa7a0 None admin] RBAC: Adding query filter params (group.id=da2229df64204c14802e836e7773f507, role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=00f7b7c66c944591aeea55c51b88d348) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:38.443531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9f4fa-b9b6-46c6-975d-d0a9b14fa7a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.446339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9f4fa-b9b6-46c6-975d-d0a9b14fa7a0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.455349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f6355-797d-41bd-848b-b9cfb35fe4b5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.455526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 194/378] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/role_assignments?group.id=da2229df64204c14802e836e7773f507&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 260 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:38.456825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937bfb-23d9-4140-a6cb-1af5d164830c None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.457115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937bfb-23d9-4140-a6cb-1af5d164830c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.457391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937bfb-23d9-4140-a6cb-1af5d164830c None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.458946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 195/379] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:38.466032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eec24c-d81e-496f-9282-0f22c0d8c16d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.471329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eec24c-d81e-496f-9282-0f22c0d8c16d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.471702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eec24c-d81e-496f-9282-0f22c0d8c16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.496037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-87eec24c-d81e-496f-9282-0f22c0d8c16d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:38.497342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-87eec24c-d81e-496f-9282-0f22c0d8c16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:38.540319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ad9b0-ddfd-4ce8-bbe3-858867aab6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.541565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ad9b0-ddfd-4ce8-bbe3-858867aab6b3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.542039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ad9b0-ddfd-4ce8-bbe3-858867aab6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.542502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ad9b0-ddfd-4ce8-bbe3-858867aab6b3 None admin] PATH_INFO: `/v3/groups/39cd26af81c04f448899929a48984bc0` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.560365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ad9b0-ddfd-4ce8-bbe3-858867aab6b3 None admin] RBAC: Authorizing `identity:get_group(group_id=39cd26af81c04f448899929a48984bc0)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.562908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ad9b0-ddfd-4ce8-bbe3-858867aab6b3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.565455 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 185/380] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/groups/39cd26af81c04f448899929a48984bc0 => generated 229 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:38.571081 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ad9b0-ddfd-4ce8-bbe3-858867aab6b3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.577577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 196/381] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:38.607170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eec24c-d81e-496f-9282-0f22c0d8c16d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.645784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.659948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.710807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ad9b0-ddfd-4ce8-bbe3-858867aab6b3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.759809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eec24c-d81e-496f-9282-0f22c0d8c16d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.783466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322ccbc-8fab-430c-af74-d25b530b769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.784172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322ccbc-8fab-430c-af74-d25b530b769b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.784457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322ccbc-8fab-430c-af74-d25b530b769b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.784731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322ccbc-8fab-430c-af74-d25b530b769b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.785573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322ccbc-8fab-430c-af74-d25b530b769b None admin] RBAC: Adding query filter params (group.id=39cd26af81c04f448899929a48984bc0, role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=a1dee3d9410543e8a4d913fcc504aee9) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:38.785888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322ccbc-8fab-430c-af74-d25b530b769b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.787350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322ccbc-8fab-430c-af74-d25b530b769b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.798314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdcd36-01d3-4ace-83bb-9fd903c9738a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.799245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 186/382] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/role_assignments?group.id=39cd26af81c04f448899929a48984bc0&scope.project.id=a1dee3d9410543e8a4d913fcc504aee9&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:38.799390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdcd36-01d3-4ace-83bb-9fd903c9738a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.799607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdcd36-01d3-4ace-83bb-9fd903c9738a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.799989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdcd36-01d3-4ace-83bb-9fd903c9738a None admin] PATH_INFO: `/v3/roles/member` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.814191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdcd36-01d3-4ace-83bb-9fd903c9738a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-f6bdcd36-01d3-4ace-83bb-9fd903c9738a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:38.822579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:38.823841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:38.824856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:38.826504 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 197/383] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:38.832422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322ccbc-8fab-430c-af74-d25b530b769b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.959802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322ccbc-8fab-430c-af74-d25b530b769b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.972903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:39.011201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff2157-a4ed-404f-88a9-f3acca3e009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.011955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff2157-a4ed-404f-88a9-f3acca3e009a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.012243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff2157-a4ed-404f-88a9-f3acca3e009a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.012519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff2157-a4ed-404f-88a9-f3acca3e009a None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.013271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff2157-a4ed-404f-88a9-f3acca3e009a None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:39.013576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff2157-a4ed-404f-88a9-f3acca3e009a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.015048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff2157-a4ed-404f-88a9-f3acca3e009a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.024818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 187/384] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:39.036728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdcd36-01d3-4ace-83bb-9fd903c9738a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.146009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:39.155807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdcd36-01d3-4ace-83bb-9fd903c9738a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.194645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786988fd-611b-4c6d-ba8d-1f5f4db45ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.195512 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786988fd-611b-4c6d-ba8d-1f5f4db45ae2 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.195818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786988fd-611b-4c6d-ba8d-1f5f4db45ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.196096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786988fd-611b-4c6d-ba8d-1f5f4db45ae2 None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.198495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786988fd-611b-4c6d-ba8d-1f5f4db45ae2 None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.200058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786988fd-611b-4c6d-ba8d-1f5f4db45ae2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.202555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 198/385] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:39 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:39.208379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff2157-a4ed-404f-88a9-f3acca3e009a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.321667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff2157-a4ed-404f-88a9-f3acca3e009a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.373539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17d9a0-3035-4fa0-ab01-a2677eaf17aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.374400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17d9a0-3035-4fa0-ab01-a2677eaf17aa None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.374687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17d9a0-3035-4fa0-ab01-a2677eaf17aa None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.374963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17d9a0-3035-4fa0-ab01-a2677eaf17aa None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.380338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17d9a0-3035-4fa0-ab01-a2677eaf17aa None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.381813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17d9a0-3035-4fa0-ab01-a2677eaf17aa None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.383698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 188/386] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:39 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:39.390210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786988fd-611b-4c6d-ba8d-1f5f4db45ae2 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.543523 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786988fd-611b-4c6d-ba8d-1f5f4db45ae2 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.595391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098030b3-d8c4-41f2-bc15-905a6a9eb15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.596223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098030b3-d8c4-41f2-bc15-905a6a9eb15b None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.596505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098030b3-d8c4-41f2-bc15-905a6a9eb15b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.596776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098030b3-d8c4-41f2-bc15-905a6a9eb15b None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4/groups/da2229df64204c14802e836e7773f507/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.600917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098030b3-d8c4-41f2-bc15-905a6a9eb15b None admin] RBAC: Authorizing `identity:create_grant(project_id=31d62d27680a4a5c899151375f3273a4, group_id=da2229df64204c14802e836e7773f507, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.602371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098030b3-d8c4-41f2-bc15-905a6a9eb15b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.726602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 199/387] 10.222.0.93 () {58 vars in 1442 bytes} [Thu May 26 16:42:39 2022] PUT /identity/v3/projects/31d62d27680a4a5c899151375f3273a4/groups/da2229df64204c14802e836e7773f507/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:39.949751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3f236-1c56-4d43-b895-3c73bcac6f77 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.950304 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3f236-1c56-4d43-b895-3c73bcac6f77 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.950304 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3f236-1c56-4d43-b895-3c73bcac6f77 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.952569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 189/388] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:39.958500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf4bf-65e8-46ed-bb98-47d91b8b8c72 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.958816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf4bf-65e8-46ed-bb98-47d91b8b8c72 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.959061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cf4bf-65e8-46ed-bb98-47d91b8b8c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.980742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e31cf4bf-65e8-46ed-bb98-47d91b8b8c72 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:39.981976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e31cf4bf-65e8-46ed-bb98-47d91b8b8c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:40.003447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:40.068331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 200/389] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:40.091842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3f236-1c56-4d43-b895-3c73bcac6f77 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.139965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:40.224046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3f236-1c56-4d43-b895-3c73bcac6f77 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.269547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b295e-0be8-411c-b7d1-b161c917824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.270357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b295e-0be8-411c-b7d1-b161c917824d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.270653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b295e-0be8-411c-b7d1-b161c917824d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.270934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b295e-0be8-411c-b7d1-b161c917824d None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.286658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b295e-0be8-411c-b7d1-b161c917824d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-990b295e-0be8-411c-b7d1-b161c917824d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:40.294332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:40.295898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:40.296776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 190/390] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:40.303604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cf4bf-65e8-46ed-bb98-47d91b8b8c72 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.419006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cf4bf-65e8-46ed-bb98-47d91b8b8c72 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.476364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b39595-a8ee-4ee8-b05e-466312520e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.476974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b39595-a8ee-4ee8-b05e-466312520e1a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.477260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b39595-a8ee-4ee8-b05e-466312520e1a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.477536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b39595-a8ee-4ee8-b05e-466312520e1a None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.478292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b39595-a8ee-4ee8-b05e-466312520e1a None admin] RBAC: Adding query filter params (name=member) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:40.478598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b39595-a8ee-4ee8-b05e-466312520e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.480012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b39595-a8ee-4ee8-b05e-466312520e1a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.495466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b295e-0be8-411c-b7d1-b161c917824d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.495925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 201/391] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:40.605461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:40.615887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b295e-0be8-411c-b7d1-b161c917824d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.652356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7425895-a0f8-48fc-a31b-5debee0c87f4 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.652673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7425895-a0f8-48fc-a31b-5debee0c87f4 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.652923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7425895-a0f8-48fc-a31b-5debee0c87f4 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.659272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 202/392] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:40.661070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cbc1-afd9-4510-b629-f12e76d1847b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.661366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cbc1-afd9-4510-b629-f12e76d1847b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.661952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cbc1-afd9-4510-b629-f12e76d1847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.663217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd37c7-d218-4fde-baac-c892b9e2ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.664547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd37c7-d218-4fde-baac-c892b9e2ce64 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.664834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd37c7-d218-4fde-baac-c892b9e2ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.665113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd37c7-d218-4fde-baac-c892b9e2ce64 None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.666326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd37c7-d218-4fde-baac-c892b9e2ce64 None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.669226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd37c7-d218-4fde-baac-c892b9e2ce64 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.671192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 191/393] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:40.678989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd37c7-d218-4fde-baac-c892b9e2ce64 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.694255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3751cbc1-afd9-4510-b629-f12e76d1847b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:40.695472 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3751cbc1-afd9-4510-b629-f12e76d1847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:40.711009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:40.849027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd37c7-d218-4fde-baac-c892b9e2ce64 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.872313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 203/394] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:40.893461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cbc1-afd9-4510-b629-f12e76d1847b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.939445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1306f5-84ed-4572-a4d9-307e00926ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.940351 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1306f5-84ed-4572-a4d9-307e00926ae5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.940631 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1306f5-84ed-4572-a4d9-307e00926ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.940903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1306f5-84ed-4572-a4d9-307e00926ae5 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.948415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1306f5-84ed-4572-a4d9-307e00926ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.949875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1306f5-84ed-4572-a4d9-307e00926ae5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.952536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 192/395] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:40.957962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1306f5-84ed-4572-a4d9-307e00926ae5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.015121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cbc1-afd9-4510-b629-f12e76d1847b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.043918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:41.061956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084ded-e3b1-4e0f-abcf-ffbfb1ee01a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.062777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084ded-e3b1-4e0f-abcf-ffbfb1ee01a8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.063061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084ded-e3b1-4e0f-abcf-ffbfb1ee01a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.063337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084ded-e3b1-4e0f-abcf-ffbfb1ee01a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.090887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45084ded-e3b1-4e0f-abcf-ffbfb1ee01a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-45084ded-e3b1-4e0f-abcf-ffbfb1ee01a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:41.115237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:41.116216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:41.117045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:41.121256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 204/396] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:41.128857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084ded-e3b1-4e0f-abcf-ffbfb1ee01a8 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.132625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:41.190603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1306f5-84ed-4572-a4d9-307e00926ae5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.233674 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78fcda-5aeb-4c7e-bbf4-70806fb72ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.234567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78fcda-5aeb-4c7e-bbf4-70806fb72ff0 None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.234901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78fcda-5aeb-4c7e-bbf4-70806fb72ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.235359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78fcda-5aeb-4c7e-bbf4-70806fb72ff0 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348/groups/da2229df64204c14802e836e7773f507/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.237302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78fcda-5aeb-4c7e-bbf4-70806fb72ff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=00f7b7c66c944591aeea55c51b88d348, group_id=da2229df64204c14802e836e7773f507, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:41.238843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78fcda-5aeb-4c7e-bbf4-70806fb72ff0 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:41.258601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084ded-e3b1-4e0f-abcf-ffbfb1ee01a8 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.294746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f57ed-fb12-4800-93f1-19fc33552950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.295446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f57ed-fb12-4800-93f1-19fc33552950 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.295763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f57ed-fb12-4800-93f1-19fc33552950 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.296043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f57ed-fb12-4800-93f1-19fc33552950 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.296791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f57ed-fb12-4800-93f1-19fc33552950 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:41.297103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f57ed-fb12-4800-93f1-19fc33552950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:41.298495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f57ed-fb12-4800-93f1-19fc33552950 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:41.307271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 205/397] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:41.311657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397134-5af1-444a-9749-c290bf7ff998 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.311657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397134-5af1-444a-9749-c290bf7ff998 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.311657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397134-5af1-444a-9749-c290bf7ff998 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.311657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 206/398] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:41.313999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397134-5af1-444a-9749-c290bf7ff998 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.341266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 193/399] 10.222.0.93 () {58 vars in 1442 bytes} [Thu May 26 16:42:40 2022] PUT /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348/groups/da2229df64204c14802e836e7773f507/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:41.342929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00348999-13c4-4171-9c2f-93f0e97b15d0 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.343420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00348999-13c4-4171-9c2f-93f0e97b15d0 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.343930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00348999-13c4-4171-9c2f-93f0e97b15d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.374508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-00348999-13c4-4171-9c2f-93f0e97b15d0 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:41.376770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-00348999-13c4-4171-9c2f-93f0e97b15d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:41.437996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:41.513313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 194/400] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:41.519278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397134-5af1-444a-9749-c290bf7ff998 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.555258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00348999-13c4-4171-9c2f-93f0e97b15d0 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.586472 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7502c0-c84c-4ee7-9c4a-367f92525374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.588515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7502c0-c84c-4ee7-9c4a-367f92525374 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.589038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7502c0-c84c-4ee7-9c4a-367f92525374 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.589523 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7502c0-c84c-4ee7-9c4a-367f92525374 None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.591668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7502c0-c84c-4ee7-9c4a-367f92525374 None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:41.593530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7502c0-c84c-4ee7-9c4a-367f92525374 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:41.595230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:41.597372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 207/401] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:41 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:41.603890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7502c0-c84c-4ee7-9c4a-367f92525374 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.723490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00348999-13c4-4171-9c2f-93f0e97b15d0 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.748788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7502c0-c84c-4ee7-9c4a-367f92525374 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.774269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10d05-0c57-4f17-8fa9-1e7bccd74bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.775963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10d05-0c57-4f17-8fa9-1e7bccd74bab None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.776391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10d05-0c57-4f17-8fa9-1e7bccd74bab None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.776807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10d05-0c57-4f17-8fa9-1e7bccd74bab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.795592 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:41.798236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f10d05-0c57-4f17-8fa9-1e7bccd74bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:41.803515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa52a18-d5b7-4387-8b5c-3bcffd253390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.808151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa52a18-d5b7-4387-8b5c-3bcffd253390 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.808151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa52a18-d5b7-4387-8b5c-3bcffd253390 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.808151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa52a18-d5b7-4387-8b5c-3bcffd253390 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-b1f10d05-0c57-4f17-8fa9-1e7bccd74bab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:41.808450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:41.809291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:41.810093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:41.810741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa52a18-d5b7-4387-8b5c-3bcffd253390 None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:41.810810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 195/402] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:41.810810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3b255-3aa4-4d10-bf3d-efdd2bc16f4e None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.810810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3b255-3aa4-4d10-bf3d-efdd2bc16f4e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.810810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3b255-3aa4-4d10-bf3d-efdd2bc16f4e None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.813644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa52a18-d5b7-4387-8b5c-3bcffd253390 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:41.815871 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 196/403] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:41.816269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 208/404] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:41 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:41.816798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3b255-3aa4-4d10-bf3d-efdd2bc16f4e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.821016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1886-90b0-4f02-8545-2b972ae3bef8 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.821601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1886-90b0-4f02-8545-2b972ae3bef8 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.822072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1886-90b0-4f02-8545-2b972ae3bef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.845862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-2ffe1886-90b0-4f02-8545-2b972ae3bef8 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:41.847412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2ffe1886-90b0-4f02-8545-2b972ae3bef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:41.919836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:41.939088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 209/405] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:41.940005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1886-90b0-4f02-8545-2b972ae3bef8 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.947335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3b255-3aa4-4d10-bf3d-efdd2bc16f4e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.995412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ff9f-cb26-4afe-8ef9-45e32214adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.997394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ff9f-cb26-4afe-8ef9-45e32214adfc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.997849 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ff9f-cb26-4afe-8ef9-45e32214adfc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.998316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ff9f-cb26-4afe-8ef9-45e32214adfc None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.999779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ff9f-cb26-4afe-8ef9-45e32214adfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:42.000627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ff9f-cb26-4afe-8ef9-45e32214adfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.002511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ff9f-cb26-4afe-8ef9-45e32214adfc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.014038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 197/406] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:42.015112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ff9f-cb26-4afe-8ef9-45e32214adfc None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.069627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1886-90b0-4f02-8545-2b972ae3bef8 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.104912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:42.109667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95b2c0-6faf-4ed4-aa6b-f626e4f59e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.111579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95b2c0-6faf-4ed4-aa6b-f626e4f59e86 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.112052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95b2c0-6faf-4ed4-aa6b-f626e4f59e86 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.112581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95b2c0-6faf-4ed4-aa6b-f626e4f59e86 None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4/groups/da2229df64204c14802e836e7773f507/roles/0c702df8791a47cb89a43521d61e4f21` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.114972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95b2c0-6faf-4ed4-aa6b-f626e4f59e86 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d62d27680a4a5c899151375f3273a4, group_id=da2229df64204c14802e836e7773f507, role_id=0c702df8791a47cb89a43521d61e4f21)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.116755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95b2c0-6faf-4ed4-aa6b-f626e4f59e86 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.125911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ff9f-cb26-4afe-8ef9-45e32214adfc None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.162224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882409fd-3e9b-46ac-be6b-a829cef8e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.163090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882409fd-3e9b-46ac-be6b-a829cef8e21c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.163374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882409fd-3e9b-46ac-be6b-a829cef8e21c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.165124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882409fd-3e9b-46ac-be6b-a829cef8e21c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.174432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882409fd-3e9b-46ac-be6b-a829cef8e21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-882409fd-3e9b-46ac-be6b-a829cef8e21c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:42.182173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:42.183376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 198/407] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:42:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:42.184258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882409fd-3e9b-46ac-be6b-a829cef8e21c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.195961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:42.254230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 210/408] 10.222.0.93 () {58 vars in 1442 bytes} [Thu May 26 16:42:41 2022] PUT /identity/v3/projects/31d62d27680a4a5c899151375f3273a4/groups/da2229df64204c14802e836e7773f507/roles/0c702df8791a47cb89a43521d61e4f21 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:42.254230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95b2c0-6faf-4ed4-aa6b-f626e4f59e86 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.369806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882409fd-3e9b-46ac-be6b-a829cef8e21c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.414430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c009-251f-4e16-8806-9387259c1260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.415597 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c009-251f-4e16-8806-9387259c1260 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.416161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c009-251f-4e16-8806-9387259c1260 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.416585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c009-251f-4e16-8806-9387259c1260 None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.417981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994c009-251f-4e16-8806-9387259c1260 None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.419630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994c009-251f-4e16-8806-9387259c1260 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.422278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 199/409] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:42 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:42.428170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c009-251f-4e16-8806-9387259c1260 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.472775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95b2c0-6faf-4ed4-aa6b-f626e4f59e86 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.510857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:42.539848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c009-251f-4e16-8806-9387259c1260 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.541425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f13b63-8b73-4941-883a-53c83f1b22fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.542140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f13b63-8b73-4941-883a-53c83f1b22fc None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.542383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f13b63-8b73-4941-883a-53c83f1b22fc None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.542660 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f13b63-8b73-4941-883a-53c83f1b22fc None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.544133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f13b63-8b73-4941-883a-53c83f1b22fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:42.544133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f13b63-8b73-4941-883a-53c83f1b22fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.545177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f13b63-8b73-4941-883a-53c83f1b22fc None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.562982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 211/410] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:42.569073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f13b63-8b73-4941-883a-53c83f1b22fc None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.580737 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a85eb-4d2d-466e-bbd2-4269cbdc1300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.581603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a85eb-4d2d-466e-bbd2-4269cbdc1300 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.582015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a85eb-4d2d-466e-bbd2-4269cbdc1300 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.582200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a85eb-4d2d-466e-bbd2-4269cbdc1300 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.583378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a85eb-4d2d-466e-bbd2-4269cbdc1300 None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.584871 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a85eb-4d2d-466e-bbd2-4269cbdc1300 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.586881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 200/411] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:42 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:42.589324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea69e-b690-41b4-a4ea-fa5e9f1e5c8d None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.589324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea69e-b690-41b4-a4ea-fa5e9f1e5c8d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.589324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea69e-b690-41b4-a4ea-fa5e9f1e5c8d None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.595021 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 201/412] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:42.595867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea69e-b690-41b4-a4ea-fa5e9f1e5c8d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.642220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:42.695952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f13b63-8b73-4941-883a-53c83f1b22fc None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.731647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea69e-b690-41b4-a4ea-fa5e9f1e5c8d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:42.738814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547220eb-570f-4b1d-a4c9-fc8cd5e6573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.739705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547220eb-570f-4b1d-a4c9-fc8cd5e6573d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.739989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547220eb-570f-4b1d-a4c9-fc8cd5e6573d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.740263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547220eb-570f-4b1d-a4c9-fc8cd5e6573d None admin] PATH_INFO: `/v3/groups/39cd26af81c04f448899929a48984bc0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.742203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547220eb-570f-4b1d-a4c9-fc8cd5e6573d None admin] RBAC: Authorizing `identity:get_group(group_id=39cd26af81c04f448899929a48984bc0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.743958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547220eb-570f-4b1d-a4c9-fc8cd5e6573d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.750014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 212/413] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:42 2022] GET /identity/v3/groups/39cd26af81c04f448899929a48984bc0 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:42.750014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91126e-03d9-417e-982d-e8b052f8e66f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.750014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91126e-03d9-417e-982d-e8b052f8e66f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.750014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91126e-03d9-417e-982d-e8b052f8e66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.770152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9b91126e-03d9-417e-982d-e8b052f8e66f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:42.771698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9b91126e-03d9-417e-982d-e8b052f8e66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:42.778544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac515a9-2241-4009-b4d7-9ff67bc7cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:42.779832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac515a9-2241-4009-b4d7-9ff67bc7cff0 None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:42.780323 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac515a9-2241-4009-b4d7-9ff67bc7cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:42.780826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac515a9-2241-4009-b4d7-9ff67bc7cff0 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348/groups/da2229df64204c14802e836e7773f507/roles/0c702df8791a47cb89a43521d61e4f21` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:42.783369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac515a9-2241-4009-b4d7-9ff67bc7cff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=00f7b7c66c944591aeea55c51b88d348, group_id=da2229df64204c14802e836e7773f507, role_id=0c702df8791a47cb89a43521d61e4f21)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:42.785128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac515a9-2241-4009-b4d7-9ff67bc7cff0 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:42.847236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 213/414] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:42.848483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91126e-03d9-417e-982d-e8b052f8e66f None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.904759 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 202/415] 10.222.0.93 () {58 vars in 1442 bytes} [Thu May 26 16:42:42 2022] PUT /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348/groups/da2229df64204c14802e836e7773f507/roles/0c702df8791a47cb89a43521d61e4f21 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:42.906085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac515a9-2241-4009-b4d7-9ff67bc7cff0 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:42.914594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:42.916828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:42.989832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91126e-03d9-417e-982d-e8b052f8e66f None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.037481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffa1c6-1e99-4cd9-9125-27ea30a6a5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.038705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa1c6-1e99-4cd9-9125-27ea30a6a5f3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.039369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa1c6-1e99-4cd9-9125-27ea30a6a5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.040913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa1c6-1e99-4cd9-9125-27ea30a6a5f3 None admin] PATH_INFO: `/v3/projects/a1dee3d9410543e8a4d913fcc504aee9` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.042496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffa1c6-1e99-4cd9-9125-27ea30a6a5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=a1dee3d9410543e8a4d913fcc504aee9)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:43.044232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffa1c6-1e99-4cd9-9125-27ea30a6a5f3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.048103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 214/416] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:42 2022] GET /identity/v3/projects/a1dee3d9410543e8a4d913fcc504aee9 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:43.054766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffa1c6-1e99-4cd9-9125-27ea30a6a5f3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:43.136173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac515a9-2241-4009-b4d7-9ff67bc7cff0 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.175241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c57637-b3e4-46dd-a2e7-d7515ee4b6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.176263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57637-b3e4-46dd-a2e7-d7515ee4b6c9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.176554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57637-b3e4-46dd-a2e7-d7515ee4b6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.176833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57637-b3e4-46dd-a2e7-d7515ee4b6c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.188583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c57637-b3e4-46dd-a2e7-d7515ee4b6c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:43.190237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffa1c6-1e99-4cd9-9125-27ea30a6a5f3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-a7c57637-b3e4-46dd-a2e7-d7515ee4b6c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:43.196605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:43.197594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:43.198396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:43.203686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 203/417] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:43.205071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c57637-b3e4-46dd-a2e7-d7515ee4b6c9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:43.215244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:43.238285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eb994-f97b-4014-bb08-a602d5c121d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.239914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eb994-f97b-4014-bb08-a602d5c121d0 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.240401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eb994-f97b-4014-bb08-a602d5c121d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.240897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eb994-f97b-4014-bb08-a602d5c121d0 None admin] PATH_INFO: `/v3/projects/a1dee3d9410543e8a4d913fcc504aee9/groups/39cd26af81c04f448899929a48984bc0/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.244025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eb994-f97b-4014-bb08-a602d5c121d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1dee3d9410543e8a4d913fcc504aee9, group_id=39cd26af81c04f448899929a48984bc0, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:43.246638 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eb994-f97b-4014-bb08-a602d5c121d0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.283864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:43.326922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c57637-b3e4-46dd-a2e7-d7515ee4b6c9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.363502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790426-5557-40ad-8804-edbd175a7e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.364199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790426-5557-40ad-8804-edbd175a7e23 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.364535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790426-5557-40ad-8804-edbd175a7e23 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.364816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790426-5557-40ad-8804-edbd175a7e23 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.365570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790426-5557-40ad-8804-edbd175a7e23 None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:43.365881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790426-5557-40ad-8804-edbd175a7e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:43.367334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790426-5557-40ad-8804-edbd175a7e23 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.377672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 204/418] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:43.383201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790426-5557-40ad-8804-edbd175a7e23 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:43.431356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 215/419] 10.222.0.93 () {58 vars in 1442 bytes} [Thu May 26 16:42:43 2022] PUT /identity/v3/projects/a1dee3d9410543e8a4d913fcc504aee9/groups/39cd26af81c04f448899929a48984bc0/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:43.499372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790426-5557-40ad-8804-edbd175a7e23 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.525956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:43.537201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fca54-f7fd-47eb-bc14-86b99f895079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.537920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fca54-f7fd-47eb-bc14-86b99f895079 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.538213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fca54-f7fd-47eb-bc14-86b99f895079 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.538534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fca54-f7fd-47eb-bc14-86b99f895079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.618636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fca54-f7fd-47eb-bc14-86b99f895079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:43.620144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fca54-f7fd-47eb-bc14-86b99f895079 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.766688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 205/420] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:42:43.772011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eb994-f97b-4014-bb08-a602d5c121d0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:43.882632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b52bf-86bd-4d80-a788-e2a3ee1a4e36 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.882977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b52bf-86bd-4d80-a788-e2a3ee1a4e36 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.883157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b52bf-86bd-4d80-a788-e2a3ee1a4e36 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.884646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 206/421] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:43.898745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eb994-f97b-4014-bb08-a602d5c121d0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:43.902766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0e6ce-e960-4b3c-b3f7-59b44ba6f31b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.903311 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0e6ce-e960-4b3c-b3f7-59b44ba6f31b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.903828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0e6ce-e960-4b3c-b3f7-59b44ba6f31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.930728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-06f0e6ce-e960-4b3c-b3f7-59b44ba6f31b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:43.937000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-06f0e6ce-e960-4b3c-b3f7-59b44ba6f31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:43.939945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bae3a-562e-466f-a2ca-e6bc59182ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:43.941755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bae3a-562e-466f-a2ca-e6bc59182ddb None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:43.941755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bae3a-562e-466f-a2ca-e6bc59182ddb None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:43.941755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bae3a-562e-466f-a2ca-e6bc59182ddb None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:43.942955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bae3a-562e-466f-a2ca-e6bc59182ddb None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:43.944494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bae3a-562e-466f-a2ca-e6bc59182ddb None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:43.950527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 216/422] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:43 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:43.953621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bae3a-562e-466f-a2ca-e6bc59182ddb None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:43.969135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.031257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 207/423] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:44.057229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.069213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0e6ce-e960-4b3c-b3f7-59b44ba6f31b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.156339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bae3a-562e-466f-a2ca-e6bc59182ddb None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.189206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0e6ce-e960-4b3c-b3f7-59b44ba6f31b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.228791 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdb482-e5f9-40d1-8ba4-b110b43dd662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.229926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdb482-e5f9-40d1-8ba4-b110b43dd662 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.230391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdb482-e5f9-40d1-8ba4-b110b43dd662 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.230843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdb482-e5f9-40d1-8ba4-b110b43dd662 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.241685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ef545-324e-4b4f-8425-a2ecddc429d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.242661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ef545-324e-4b4f-8425-a2ecddc429d9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.242953 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ef545-324e-4b4f-8425-a2ecddc429d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.243233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ef545-324e-4b4f-8425-a2ecddc429d9 None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.244639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ef545-324e-4b4f-8425-a2ecddc429d9 None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.246093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ef545-324e-4b4f-8425-a2ecddc429d9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:44.247092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdb482-e5f9-40d1-8ba4-b110b43dd662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:44.256152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 217/424] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:43 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:44.257274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ef545-324e-4b4f-8425-a2ecddc429d9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-72bdb482-e5f9-40d1-8ba4-b110b43dd662 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:44.260734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:44.261725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:42:44.262560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:44.265361 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 208/425] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:44.273794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdb482-e5f9-40d1-8ba4-b110b43dd662 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.307047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.423194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ef545-324e-4b4f-8425-a2ecddc429d9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.454797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.472347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdb482-e5f9-40d1-8ba4-b110b43dd662 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.504313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81042f7-3ca2-4483-a348-2a247b52ca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.504982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81042f7-3ca2-4483-a348-2a247b52ca20 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.505273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81042f7-3ca2-4483-a348-2a247b52ca20 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.505553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81042f7-3ca2-4483-a348-2a247b52ca20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.506398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81042f7-3ca2-4483-a348-2a247b52ca20 None admin] RBAC: Adding query filter params (group.id=da2229df64204c14802e836e7773f507, role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=31d62d27680a4a5c899151375f3273a4) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:44.506709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81042f7-3ca2-4483-a348-2a247b52ca20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.508216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81042f7-3ca2-4483-a348-2a247b52ca20 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:44.521505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992da15-5403-4205-bcd7-d83a0026e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.522421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992da15-5403-4205-bcd7-d83a0026e2a8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.522856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992da15-5403-4205-bcd7-d83a0026e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.523305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992da15-5403-4205-bcd7-d83a0026e2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.523751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 218/426] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:44 2022] GET /identity/v3/role_assignments?group.id=da2229df64204c14802e836e7773f507&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 611 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:44.524489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992da15-5403-4205-bcd7-d83a0026e2a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:44.525138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992da15-5403-4205-bcd7-d83a0026e2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.526695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992da15-5403-4205-bcd7-d83a0026e2a8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:44.538449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 209/427] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:44.549090 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81042f7-3ca2-4483-a348-2a247b52ca20 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.724756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81042f7-3ca2-4483-a348-2a247b52ca20 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.775706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381b4a-9642-47e2-b276-4b57f9f2417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.776408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381b4a-9642-47e2-b276-4b57f9f2417e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.776687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381b4a-9642-47e2-b276-4b57f9f2417e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.776966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381b4a-9642-47e2-b276-4b57f9f2417e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.833848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.855545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32381b4a-9642-47e2-b276-4b57f9f2417e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.857028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32381b4a-9642-47e2-b276-4b57f9f2417e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:44.965867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 219/428] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:44.971614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992da15-5403-4205-bcd7-d83a0026e2a8 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.108934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:45.138940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3d294-04ef-46bd-8e5a-bebbf7decd0d None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.139442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3d294-04ef-46bd-8e5a-bebbf7decd0d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.139517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3d294-04ef-46bd-8e5a-bebbf7decd0d None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.140721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992da15-5403-4205-bcd7-d83a0026e2a8 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.141138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 220/429] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:45.146541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348a500-a8b9-49f1-a6a1-3b23b9dbcc0e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.146828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348a500-a8b9-49f1-a6a1-3b23b9dbcc0e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.147109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348a500-a8b9-49f1-a6a1-3b23b9dbcc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.166957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e348a500-a8b9-49f1-a6a1-3b23b9dbcc0e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:45.168179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e348a500-a8b9-49f1-a6a1-3b23b9dbcc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.195100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18a0c8-9f11-485a-98e5-729431616acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.196789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18a0c8-9f11-485a-98e5-729431616acf None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.197279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18a0c8-9f11-485a-98e5-729431616acf None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.197779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18a0c8-9f11-485a-98e5-729431616acf None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.200287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18a0c8-9f11-485a-98e5-729431616acf None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.202947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18a0c8-9f11-485a-98e5-729431616acf None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.203742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 210/430] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:44 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:45.209637 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18a0c8-9f11-485a-98e5-729431616acf None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.260586 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 221/431] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:45.287177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348a500-a8b9-49f1-a6a1-3b23b9dbcc0e None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.299005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:45.339465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18a0c8-9f11-485a-98e5-729431616acf None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.387461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306081b-8ae7-40d7-8d23-7bc0db521e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.388808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306081b-8ae7-40d7-8d23-7bc0db521e5a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.389095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306081b-8ae7-40d7-8d23-7bc0db521e5a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.389527 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306081b-8ae7-40d7-8d23-7bc0db521e5a None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.390873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306081b-8ae7-40d7-8d23-7bc0db521e5a None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.392814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306081b-8ae7-40d7-8d23-7bc0db521e5a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.397284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 211/432] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:45 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:45.402348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306081b-8ae7-40d7-8d23-7bc0db521e5a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.422947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:45.427065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348a500-a8b9-49f1-a6a1-3b23b9dbcc0e None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.476093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811f27-9cf6-4e15-bbea-10f03efe3c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.476935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811f27-9cf6-4e15-bbea-10f03efe3c7d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.477259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811f27-9cf6-4e15-bbea-10f03efe3c7d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.477493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811f27-9cf6-4e15-bbea-10f03efe3c7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.494395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d811f27-9cf6-4e15-bbea-10f03efe3c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-2d811f27-9cf6-4e15-bbea-10f03efe3c7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:45.504760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:45.505791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:45.506618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:45.507460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 222/433] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:45.514162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811f27-9cf6-4e15-bbea-10f03efe3c7d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.523664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306081b-8ae7-40d7-8d23-7bc0db521e5a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.567141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb2a5b-f37b-4b58-827b-4cc8c9eb4885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.567830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb2a5b-f37b-4b58-827b-4cc8c9eb4885 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.568115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb2a5b-f37b-4b58-827b-4cc8c9eb4885 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.568394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb2a5b-f37b-4b58-827b-4cc8c9eb4885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.569232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb2a5b-f37b-4b58-827b-4cc8c9eb4885 None admin] RBAC: Adding query filter params (group.id=da2229df64204c14802e836e7773f507, role.id=9921f4d7024b4fec93767ff982451ef7, scope.project.id=00f7b7c66c944591aeea55c51b88d348) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:45.569945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb2a5b-f37b-4b58-827b-4cc8c9eb4885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.571755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb2a5b-f37b-4b58-827b-4cc8c9eb4885 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.580148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 212/434] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:45 2022] GET /identity/v3/role_assignments?group.id=da2229df64204c14802e836e7773f507&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=9921f4d7024b4fec93767ff982451ef7 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:45.606118 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:45.640688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811f27-9cf6-4e15-bbea-10f03efe3c7d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.679362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9241d-1ede-44b9-a294-92f45e3e5bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.680375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9241d-1ede-44b9-a294-92f45e3e5bcd None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.681296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9241d-1ede-44b9-a294-92f45e3e5bcd None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.681573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9241d-1ede-44b9-a294-92f45e3e5bcd None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.682322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9241d-1ede-44b9-a294-92f45e3e5bcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:45.682627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9241d-1ede-44b9-a294-92f45e3e5bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.684213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9241d-1ede-44b9-a294-92f45e3e5bcd None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.687851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cfc2d-36c5-4b14-896c-fd9e72e4a92a None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.687851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cfc2d-36c5-4b14-896c-fd9e72e4a92a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.687851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cfc2d-36c5-4b14-896c-fd9e72e4a92a None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.693382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 213/435] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:42:45.693520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 223/436] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:45.695283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979bf12-0129-4a24-a3b9-84412b951907 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.695584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979bf12-0129-4a24-a3b9-84412b951907 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.695880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979bf12-0129-4a24-a3b9-84412b951907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.700341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9241d-1ede-44b9-a294-92f45e3e5bcd None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.718961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f979bf12-0129-4a24-a3b9-84412b951907 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:45.720242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f979bf12-0129-4a24-a3b9-84412b951907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.815843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 214/437] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:45.824966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9241d-1ede-44b9-a294-92f45e3e5bcd None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.840275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979bf12-0129-4a24-a3b9-84412b951907 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.852146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:45.860491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:45.866691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fb79f-f6d0-4a7f-925a-c339409d455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.867341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fb79f-f6d0-4a7f-925a-c339409d455b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.870990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fb79f-f6d0-4a7f-925a-c339409d455b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.870990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fb79f-f6d0-4a7f-925a-c339409d455b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.950371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fb79f-f6d0-4a7f-925a-c339409d455b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.953670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fb79f-f6d0-4a7f-925a-c339409d455b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.967875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979bf12-0129-4a24-a3b9-84412b951907 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.011056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5e52b-8781-472a-ba25-09ca3b932156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.012011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5e52b-8781-472a-ba25-09ca3b932156 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.012359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5e52b-8781-472a-ba25-09ca3b932156 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.012701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5e52b-8781-472a-ba25-09ca3b932156 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.024903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5e52b-8781-472a-ba25-09ca3b932156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-c4e5e52b-8781-472a-ba25-09ca3b932156 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:46.035140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:46.036184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:46.037146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 215/438] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:42:46.042523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5e52b-8781-472a-ba25-09ca3b932156 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.069319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 224/439] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:46.070440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fb79f-f6d0-4a7f-925a-c339409d455b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.104011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.118744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.157773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5e52b-8781-472a-ba25-09ca3b932156 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.178649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fb79f-f6d0-4a7f-925a-c339409d455b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.191765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9d89b-be44-4e88-9352-e4c404114ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.192440 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9d89b-be44-4e88-9352-e4c404114ee5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.192745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9d89b-be44-4e88-9352-e4c404114ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.193032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9d89b-be44-4e88-9352-e4c404114ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.193756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9d89b-be44-4e88-9352-e4c404114ee5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:46.194066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9d89b-be44-4e88-9352-e4c404114ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.195458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9d89b-be44-4e88-9352-e4c404114ee5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.205631 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 216/440] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:46.211032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9d89b-be44-4e88-9352-e4c404114ee5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.223861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54485d-efe4-472d-8bab-5934ba39dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.225042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54485d-efe4-472d-8bab-5934ba39dbdf None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.225463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54485d-efe4-472d-8bab-5934ba39dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.225899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54485d-efe4-472d-8bab-5934ba39dbdf None admin] PATH_INFO: `/v3/projects/31d62d27680a4a5c899151375f3273a4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.227507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54485d-efe4-472d-8bab-5934ba39dbdf None admin] RBAC: Authorizing `identity:get_project(project_id=31d62d27680a4a5c899151375f3273a4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.228982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54485d-efe4-472d-8bab-5934ba39dbdf None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.231079 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 225/441] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/projects/31d62d27680a4a5c899151375f3273a4 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:46.232577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f65bd-432e-4576-99d1-57f7c44b5ba1 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.232859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f65bd-432e-4576-99d1-57f7c44b5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.233123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f65bd-432e-4576-99d1-57f7c44b5ba1 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.234575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 226/442] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:46.236312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f65bd-432e-4576-99d1-57f7c44b5ba1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.311826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9d89b-be44-4e88-9352-e4c404114ee5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.334063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.337439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.338896 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f65bd-432e-4576-99d1-57f7c44b5ba1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.345568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33dba-370e-4374-9b5a-acf2db6670b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.346215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33dba-370e-4374-9b5a-acf2db6670b8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.346503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33dba-370e-4374-9b5a-acf2db6670b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.346815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33dba-370e-4374-9b5a-acf2db6670b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.373597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c8231-93f6-40e7-950d-30dff2eb07ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.374500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8231-93f6-40e7-950d-30dff2eb07ae None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.374988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8231-93f6-40e7-950d-30dff2eb07ae None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.375929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8231-93f6-40e7-950d-30dff2eb07ae None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.377264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8231-93f6-40e7-950d-30dff2eb07ae None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.378704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8231-93f6-40e7-950d-30dff2eb07ae None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.380362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 227/443] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:46.381508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13525fe0-0b98-4718-aa9e-368283df3cee None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.381786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13525fe0-0b98-4718-aa9e-368283df3cee None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.382062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13525fe0-0b98-4718-aa9e-368283df3cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.399219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-13525fe0-0b98-4718-aa9e-368283df3cee None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:46.400434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-13525fe0-0b98-4718-aa9e-368283df3cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.420200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e33dba-370e-4374-9b5a-acf2db6670b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.421584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e33dba-370e-4374-9b5a-acf2db6670b8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.473683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 228/444] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:46.474533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13525fe0-0b98-4718-aa9e-368283df3cee None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.526868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 217/445] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:42:46.527724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33dba-370e-4374-9b5a-acf2db6670b8 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.554856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.574193 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.580266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13525fe0-0b98-4718-aa9e-368283df3cee None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.615795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed740-a385-4cd2-acad-d8f49727ddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.615795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed740-a385-4cd2-acad-d8f49727ddf3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.615795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed740-a385-4cd2-acad-d8f49727ddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.615795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed740-a385-4cd2-acad-d8f49727ddf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.616335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed740-a385-4cd2-acad-d8f49727ddf3 None admin] RBAC: Adding query filter params (group.id=da2229df64204c14802e836e7773f507, role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=31d62d27680a4a5c899151375f3273a4) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:46.616664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed740-a385-4cd2-acad-d8f49727ddf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.618121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed740-a385-4cd2-acad-d8f49727ddf3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.624674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 229/446] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/role_assignments?group.id=da2229df64204c14802e836e7773f507&scope.project.id=31d62d27680a4a5c899151375f3273a4&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:46.625356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed740-a385-4cd2-acad-d8f49727ddf3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.625553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33dba-370e-4374-9b5a-acf2db6670b8 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.664816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7e8c7-4da6-4dbb-be31-db48ad6a7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.665628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7e8c7-4da6-4dbb-be31-db48ad6a7bec None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.665911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7e8c7-4da6-4dbb-be31-db48ad6a7bec None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.666188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7e8c7-4da6-4dbb-be31-db48ad6a7bec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.678085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7e8c7-4da6-4dbb-be31-db48ad6a7bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-71d7e8c7-4da6-4dbb-be31-db48ad6a7bec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:46.686538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:46.687619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:46.688574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 218/447] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:46.694061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7e8c7-4da6-4dbb-be31-db48ad6a7bec None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.766657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed740-a385-4cd2-acad-d8f49727ddf3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.802798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.814025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee409-195e-4bf0-9339-504035bd4753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.814220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee409-195e-4bf0-9339-504035bd4753 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.814439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee409-195e-4bf0-9339-504035bd4753 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.814686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee409-195e-4bf0-9339-504035bd4753 None admin] PATH_INFO: `/v3/projects/00f7b7c66c944591aeea55c51b88d348` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.815925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee409-195e-4bf0-9339-504035bd4753 None admin] RBAC: Authorizing `identity:get_project(project_id=00f7b7c66c944591aeea55c51b88d348)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.817366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee409-195e-4bf0-9339-504035bd4753 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.817468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7e8c7-4da6-4dbb-be31-db48ad6a7bec None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.823550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 230/448] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/projects/00f7b7c66c944591aeea55c51b88d348 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:46.825366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee409-195e-4bf0-9339-504035bd4753 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.854663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257203-1c8e-4ae4-9c75-ae2366b8a59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.855342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257203-1c8e-4ae4-9c75-ae2366b8a59a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.873451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257203-1c8e-4ae4-9c75-ae2366b8a59a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.873451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257203-1c8e-4ae4-9c75-ae2366b8a59a None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.873451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257203-1c8e-4ae4-9c75-ae2366b8a59a None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:46.873451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257203-1c8e-4ae4-9c75-ae2366b8a59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.873779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.873852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257203-1c8e-4ae4-9c75-ae2366b8a59a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.873852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 219/449] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:46.875038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257203-1c8e-4ae4-9c75-ae2366b8a59a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.948289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee409-195e-4bf0-9339-504035bd4753 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.986474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2535609-3107-4a10-a34e-120a7d2ebf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.987330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2535609-3107-4a10-a34e-120a7d2ebf81 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.987631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2535609-3107-4a10-a34e-120a7d2ebf81 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.987901 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2535609-3107-4a10-a34e-120a7d2ebf81 None admin] PATH_INFO: `/v3/groups/da2229df64204c14802e836e7773f507` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.989580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2535609-3107-4a10-a34e-120a7d2ebf81 None admin] RBAC: Authorizing `identity:get_group(group_id=da2229df64204c14802e836e7773f507)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.991032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2535609-3107-4a10-a34e-120a7d2ebf81 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.992880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 231/450] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/groups/da2229df64204c14802e836e7773f507 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:46.999667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2535609-3107-4a10-a34e-120a7d2ebf81 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.004522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257203-1c8e-4ae4-9c75-ae2366b8a59a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.044512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ace4ed-937c-45dc-9b57-a9e4f8a4f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.045345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ace4ed-937c-45dc-9b57-a9e4f8a4f385 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.045792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ace4ed-937c-45dc-9b57-a9e4f8a4f385 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.046238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ace4ed-937c-45dc-9b57-a9e4f8a4f385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.068780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:47.118066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:47.126043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2535609-3107-4a10-a34e-120a7d2ebf81 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.130931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ace4ed-937c-45dc-9b57-a9e4f8a4f385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.132470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ace4ed-937c-45dc-9b57-a9e4f8a4f385 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.171817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120cfe2-50d2-44a1-83db-eaf73053177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.173312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120cfe2-50d2-44a1-83db-eaf73053177f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.173606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120cfe2-50d2-44a1-83db-eaf73053177f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.173890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120cfe2-50d2-44a1-83db-eaf73053177f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.174713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120cfe2-50d2-44a1-83db-eaf73053177f None admin] RBAC: Adding query filter params (group.id=da2229df64204c14802e836e7773f507, role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=00f7b7c66c944591aeea55c51b88d348) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:47.175019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120cfe2-50d2-44a1-83db-eaf73053177f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.178436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120cfe2-50d2-44a1-83db-eaf73053177f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.187415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 232/451] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/role_assignments?group.id=da2229df64204c14802e836e7773f507&scope.project.id=00f7b7c66c944591aeea55c51b88d348&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:47.265114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 220/452] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:47.270989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120cfe2-50d2-44a1-83db-eaf73053177f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.377710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120cfe2-50d2-44a1-83db-eaf73053177f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.411262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99fa7f-85a4-4794-902a-9f952ae9936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.412144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99fa7f-85a4-4794-902a-9f952ae9936a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.412424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99fa7f-85a4-4794-902a-9f952ae9936a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.412694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99fa7f-85a4-4794-902a-9f952ae9936a None admin] PATH_INFO: `/v3/projects/a1dee3d9410543e8a4d913fcc504aee9` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.413891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99fa7f-85a4-4794-902a-9f952ae9936a None admin] RBAC: Authorizing `identity:get_project(project_id=a1dee3d9410543e8a4d913fcc504aee9)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.415319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99fa7f-85a4-4794-902a-9f952ae9936a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.417038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 233/453] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:42:47 2022] GET /identity/v3/projects/a1dee3d9410543e8a4d913fcc504aee9 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:47.423125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ace4ed-937c-45dc-9b57-a9e4f8a4f385 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.476396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:47.527474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ace4ed-937c-45dc-9b57-a9e4f8a4f385 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.563680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeecc6c-d501-4978-8082-695eb8cc39a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.564549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeecc6c-d501-4978-8082-695eb8cc39a3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.564829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeecc6c-d501-4978-8082-695eb8cc39a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.565095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeecc6c-d501-4978-8082-695eb8cc39a3 None admin] PATH_INFO: `/v3/groups/39cd26af81c04f448899929a48984bc0` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.566279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeecc6c-d501-4978-8082-695eb8cc39a3 None admin] RBAC: Authorizing `identity:get_group(group_id=39cd26af81c04f448899929a48984bc0)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.567781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeecc6c-d501-4978-8082-695eb8cc39a3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.569405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 221/454] 10.222.0.93 () {56 vars in 1180 bytes} [Thu May 26 16:42:47 2022] GET /identity/v3/groups/39cd26af81c04f448899929a48984bc0 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:47.575405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99fa7f-85a4-4794-902a-9f952ae9936a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.602802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:47.671233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99fa7f-85a4-4794-902a-9f952ae9936a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.704303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5bb4c-1dc4-4db9-8791-1a5ef3b18afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.705013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5bb4c-1dc4-4db9-8791-1a5ef3b18afa None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.705293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5bb4c-1dc4-4db9-8791-1a5ef3b18afa None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.705566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5bb4c-1dc4-4db9-8791-1a5ef3b18afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.706391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5bb4c-1dc4-4db9-8791-1a5ef3b18afa None admin] RBAC: Adding query filter params (group.id=39cd26af81c04f448899929a48984bc0, role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=a1dee3d9410543e8a4d913fcc504aee9) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:47.706709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5bb4c-1dc4-4db9-8791-1a5ef3b18afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.708174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5bb4c-1dc4-4db9-8791-1a5ef3b18afa None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.713865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 234/455] 10.222.0.93 () {56 vars in 1376 bytes} [Thu May 26 16:42:47 2022] GET /identity/v3/role_assignments?group.id=39cd26af81c04f448899929a48984bc0&scope.project.id=a1dee3d9410543e8a4d913fcc504aee9&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:50.343418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63f3b-e4de-4a8f-ae0a-53a7241aeef0 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.345011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63f3b-e4de-4a8f-ae0a-53a7241aeef0 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.345823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63f3b-e4de-4a8f-ae0a-53a7241aeef0 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.350887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 222/456] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:50.358437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2117b-288f-4dfe-a7b8-cc13aa1b3562 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.359824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2117b-288f-4dfe-a7b8-cc13aa1b3562 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.360584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2117b-288f-4dfe-a7b8-cc13aa1b3562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.399883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-bbf2117b-288f-4dfe-a7b8-cc13aa1b3562 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:50.402318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bbf2117b-288f-4dfe-a7b8-cc13aa1b3562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.501906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 235/457] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:50.581959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63f3b-e4de-4a8f-ae0a-53a7241aeef0 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.728296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63f3b-e4de-4a8f-ae0a-53a7241aeef0 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.751506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:50.772068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd2ab-e8c2-46e4-926a-8a0252350231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.772861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd2ab-e8c2-46e4-926a-8a0252350231 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.773135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd2ab-e8c2-46e4-926a-8a0252350231 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.773411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd2ab-e8c2-46e4-926a-8a0252350231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.795517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffd2ab-e8c2-46e4-926a-8a0252350231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.797126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffd2ab-e8c2-46e4-926a-8a0252350231 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9fffd2ab-e8c2-46e4-926a-8a0252350231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:50.819106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:50.820928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:50.822595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:50.822595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:50.822595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:50.822595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:50.822595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 223/458] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:50.829628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2117b-288f-4dfe-a7b8-cc13aa1b3562 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.867976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:50.947754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2117b-288f-4dfe-a7b8-cc13aa1b3562 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.983499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331d0f5-20a1-4611-9206-11bdc1446dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.984205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331d0f5-20a1-4611-9206-11bdc1446dba None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.984487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331d0f5-20a1-4611-9206-11bdc1446dba None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.984764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331d0f5-20a1-4611-9206-11bdc1446dba None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.985487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331d0f5-20a1-4611-9206-11bdc1446dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:50.985788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331d0f5-20a1-4611-9206-11bdc1446dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.987203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331d0f5-20a1-4611-9206-11bdc1446dba None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.007996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 236/459] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:51.015002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd2ab-e8c2-46e4-926a-8a0252350231 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.219015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd2ab-e8c2-46e4-926a-8a0252350231 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.249240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1849ad-6e04-469f-8309-4ecb9b7cbd85 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.250096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1849ad-6e04-469f-8309-4ecb9b7cbd85 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.250582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1849ad-6e04-469f-8309-4ecb9b7cbd85 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.252800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 237/460] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:51.258778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312a88-ab29-4030-b532-5bc4bd450e02 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.259056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312a88-ab29-4030-b532-5bc4bd450e02 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.259503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312a88-ab29-4030-b532-5bc4bd450e02 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.261211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 238/461] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:51.262681 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de8689-3997-41d2-91db-1c281b4dfb8b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.263352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de8689-3997-41d2-91db-1c281b4dfb8b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.268226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de8689-3997-41d2-91db-1c281b4dfb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.285183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9f39d-1136-4e32-a2d6-0a651be2401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.286357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9f39d-1136-4e32-a2d6-0a651be2401a None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.286868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9f39d-1136-4e32-a2d6-0a651be2401a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.287510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9f39d-1136-4e32-a2d6-0a651be2401a None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.288940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9f39d-1136-4e32-a2d6-0a651be2401a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.289397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f5de8689-3997-41d2-91db-1c281b4dfb8b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:51.290776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f5de8689-3997-41d2-91db-1c281b4dfb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.291897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9f39d-1136-4e32-a2d6-0a651be2401a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.368237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 239/462] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:51.369589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7c0ac-f2e1-40f7-9f75-5c2faed7210d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.369877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7c0ac-f2e1-40f7-9f75-5c2faed7210d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.370150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7c0ac-f2e1-40f7-9f75-5c2faed7210d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.390207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-35a7c0ac-f2e1-40f7-9f75-5c2faed7210d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:51.394443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-35a7c0ac-f2e1-40f7-9f75-5c2faed7210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.401850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:51.411594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 224/463] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:51 2022] POST /identity/v3/users => generated 246 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:51.411594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63222cd-2280-4e88-ba45-575463aa4dfd None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.411594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63222cd-2280-4e88-ba45-575463aa4dfd None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.411594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63222cd-2280-4e88-ba45-575463aa4dfd None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.411594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 225/464] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:51.412995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63222cd-2280-4e88-ba45-575463aa4dfd None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.450845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:51.506553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 240/465] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:51.508590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879c3c5-cb05-4ec1-9035-6b10cbc8fc9e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.509179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879c3c5-cb05-4ec1-9035-6b10cbc8fc9e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.509663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879c3c5-cb05-4ec1-9035-6b10cbc8fc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.533710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-7879c3c5-cb05-4ec1-9035-6b10cbc8fc9e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:51.536249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7879c3c5-cb05-4ec1-9035-6b10cbc8fc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.580601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63222cd-2280-4e88-ba45-575463aa4dfd None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.642522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aa95b-4cb2-4308-93a7-9c0d3160bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.644646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aa95b-4cb2-4308-93a7-9c0d3160bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.645218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aa95b-4cb2-4308-93a7-9c0d3160bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.645862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aa95b-4cb2-4308-93a7-9c0d3160bbe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.652686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 241/466] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:51.653314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879c3c5-cb05-4ec1-9035-6b10cbc8fc9e None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.665512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aa95b-4cb2-4308-93a7-9c0d3160bbe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.667082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aa95b-4cb2-4308-93a7-9c0d3160bbe8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-e99aa95b-4cb2-4308-93a7-9c0d3160bbe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:51.698540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:51.699633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:51.700494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:51.700494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:51.700494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:51.700494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:51.701936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 226/467] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:51.702385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aa95b-4cb2-4308-93a7-9c0d3160bbe8 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.771325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:51.819115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:51.824569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879c3c5-cb05-4ec1-9035-6b10cbc8fc9e None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.857408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aa95b-4cb2-4308-93a7-9c0d3160bbe8 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.869128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec357-27b0-4ac7-9ffd-29e2a39cd36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.869939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec357-27b0-4ac7-9ffd-29e2a39cd36e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.870226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec357-27b0-4ac7-9ffd-29e2a39cd36e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.870504 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec357-27b0-4ac7-9ffd-29e2a39cd36e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.883317 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aec357-27b0-4ac7-9ffd-29e2a39cd36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.884909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aec357-27b0-4ac7-9ffd-29e2a39cd36e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.900496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e923c-fd08-467a-bbc2-85b78fa8a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.901329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e923c-fd08-467a-bbc2-85b78fa8a77a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.901610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e923c-fd08-467a-bbc2-85b78fa8a77a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.901886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e923c-fd08-467a-bbc2-85b78fa8a77a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-77aec357-27b0-4ac7-9ffd-29e2a39cd36e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:51.907935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:51.908879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:51.909764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:51.909764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:51.909764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:51.909764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:51.915198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 242/468] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:51.916318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec357-27b0-4ac7-9ffd-29e2a39cd36e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.917139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e923c-fd08-467a-bbc2-85b78fa8a77a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.920585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e923c-fd08-467a-bbc2-85b78fa8a77a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-5f3e923c-fd08-467a-bbc2-85b78fa8a77a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:51.944830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:51.945768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:51.946694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:51.946694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:51.946694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:51.946694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:51.949071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 227/469] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:51.950175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e923c-fd08-467a-bbc2-85b78fa8a77a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.055522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec357-27b0-4ac7-9ffd-29e2a39cd36e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.086526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:52.099460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17552b-766a-4cda-8118-b062e5cbaaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.100176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17552b-766a-4cda-8118-b062e5cbaaa9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.100459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17552b-766a-4cda-8118-b062e5cbaaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.100735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17552b-766a-4cda-8118-b062e5cbaaa9 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.101485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17552b-766a-4cda-8118-b062e5cbaaa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:52.101793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17552b-766a-4cda-8118-b062e5cbaaa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.103221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17552b-766a-4cda-8118-b062e5cbaaa9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.111872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e923c-fd08-467a-bbc2-85b78fa8a77a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.121785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 243/470] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:52.121785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17552b-766a-4cda-8118-b062e5cbaaa9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.151735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:52.157614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9456884-b419-4a5c-86cf-401f1d49624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.158492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9456884-b419-4a5c-86cf-401f1d49624b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.159162 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9456884-b419-4a5c-86cf-401f1d49624b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.161038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9456884-b419-4a5c-86cf-401f1d49624b None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.161038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9456884-b419-4a5c-86cf-401f1d49624b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:52.161038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9456884-b419-4a5c-86cf-401f1d49624b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.162026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9456884-b419-4a5c-86cf-401f1d49624b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.175990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 228/471] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:52.182681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b7318-a8bf-4c83-8e76-cc332e3029c9 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.183301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b7318-a8bf-4c83-8e76-cc332e3029c9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.184099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b7318-a8bf-4c83-8e76-cc332e3029c9 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.186057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 229/472] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:52.186765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b7318-a8bf-4c83-8e76-cc332e3029c9 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.261424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17552b-766a-4cda-8118-b062e5cbaaa9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.298559 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe49f07-15f9-4278-a6b4-868291d65fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.299354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe49f07-15f9-4278-a6b4-868291d65fd9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.299667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe49f07-15f9-4278-a6b4-868291d65fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.299971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe49f07-15f9-4278-a6b4-868291d65fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.300673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe49f07-15f9-4278-a6b4-868291d65fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:52.300993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe49f07-15f9-4278-a6b4-868291d65fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.302367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe49f07-15f9-4278-a6b4-868291d65fd9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.310849 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b7318-a8bf-4c83-8e76-cc332e3029c9 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.316797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 244/473] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:52.322253 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe49f07-15f9-4278-a6b4-868291d65fd9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.353759 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577c659-925f-49d7-951e-851c301ba409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.354416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577c659-925f-49d7-951e-851c301ba409 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.354709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577c659-925f-49d7-951e-851c301ba409 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.354989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577c659-925f-49d7-951e-851c301ba409 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.355742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577c659-925f-49d7-951e-851c301ba409 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.357750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577c659-925f-49d7-951e-851c301ba409 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.373386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:52.427953 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe49f07-15f9-4278-a6b4-868291d65fd9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.460835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec6a5-1859-495a-81b2-14c1e75a9f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.461625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec6a5-1859-495a-81b2-14c1e75a9f51 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.461917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec6a5-1859-495a-81b2-14c1e75a9f51 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.462189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec6a5-1859-495a-81b2-14c1e75a9f51 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.462897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec6a5-1859-495a-81b2-14c1e75a9f51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.464383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec6a5-1859-495a-81b2-14c1e75a9f51 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.477384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 230/474] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:52.477384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826973-b433-418f-ac30-e63ae5d9ec3f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.477384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826973-b433-418f-ac30-e63ae5d9ec3f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.477384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826973-b433-418f-ac30-e63ae5d9ec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.499073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3a826973-b433-418f-ac30-e63ae5d9ec3f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:52.500349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3a826973-b433-418f-ac30-e63ae5d9ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.555390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:52.588373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 245/475] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/users => generated 249 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:52.590056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec6a5-1859-495a-81b2-14c1e75a9f51 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.602563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 231/476] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:52.633197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a826973-b433-418f-ac30-e63ae5d9ec3f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.773827 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:52.778706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec6a5-1859-495a-81b2-14c1e75a9f51 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.783431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a826973-b433-418f-ac30-e63ae5d9ec3f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.825915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957deac-349b-4f96-8c51-77ce21a0056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.826966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957deac-349b-4f96-8c51-77ce21a0056c None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.827692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.827839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957deac-349b-4f96-8c51-77ce21a0056c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.828946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.828946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.828946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.830161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.831125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.831517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957deac-349b-4f96-8c51-77ce21a0056c None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.834542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957deac-349b-4f96-8c51-77ce21a0056c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.836327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957deac-349b-4f96-8c51-77ce21a0056c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.891641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.sql.core [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:42:52.891641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:42:52.891641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [parameters: {'id': '1aa2aedbf8334c8ba4c2846c623c9029', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:42:52.891641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97428) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application conn.query(q) May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application result.read() May 26 16:42:52.909473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return ref.to_dict() May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:42:52.910407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application next(self.gen) May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application yield resource May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application next(self.gen) May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise self.value May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application session.commit() May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:42:52.911343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.session.flush() May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application compat.raise_( May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:42:52.912263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:42:52.913224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application conn.query(q) May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application result.read() May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:42:52.914151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [parameters: {'id': '1aa2aedbf8334c8ba4c2846c623c9029', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:52.914994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:42:52.917532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:52.919534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 232/477] 10.222.0.93 () {60 vars in 1131 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/roles => generated 144 bytes in 279 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:52.919534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.968637 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:53.006386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 246/478] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/users => generated 248 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:53.048751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75797d2-1eda-49f5-bdc9-6778bf4d2b3c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.093570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cbb66-cf5d-43d8-8365-44fc49313510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.094483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cbb66-cf5d-43d8-8365-44fc49313510 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.094827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cbb66-cf5d-43d8-8365-44fc49313510 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.095127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cbb66-cf5d-43d8-8365-44fc49313510 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.115883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cbb66-cf5d-43d8-8365-44fc49313510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-af2cbb66-cf5d-43d8-8365-44fc49313510 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:53.125082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:53.126063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:42:53.126899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:53.131748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 233/479] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:42:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:53.133895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957deac-349b-4f96-8c51-77ce21a0056c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.292557 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957deac-349b-4f96-8c51-77ce21a0056c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.353804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedd12-9033-4afa-9b9a-c76ad43d8ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.354495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedd12-9033-4afa-9b9a-c76ad43d8ef3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.354776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedd12-9033-4afa-9b9a-c76ad43d8ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.355050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedd12-9033-4afa-9b9a-c76ad43d8ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.355837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeedd12-9033-4afa-9b9a-c76ad43d8ef3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:53.356141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeedd12-9033-4afa-9b9a-c76ad43d8ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.358081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeedd12-9033-4afa-9b9a-c76ad43d8ef3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.369809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 247/480] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:54.094361 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603f3d-9b95-499f-a752-9c0f6e8385a9 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.094916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603f3d-9b95-499f-a752-9c0f6e8385a9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.094995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603f3d-9b95-499f-a752-9c0f6e8385a9 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.100795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 234/481] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:54.107511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a0053-8467-4832-9a69-4009a5a31348 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.108000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a0053-8467-4832-9a69-4009a5a31348 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.108074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a0053-8467-4832-9a69-4009a5a31348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.133155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5d6a0053-8467-4832-9a69-4009a5a31348 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:54.134277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5d6a0053-8467-4832-9a69-4009a5a31348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:54.157839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:54.241279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 248/482] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:54.281626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603f3d-9b95-499f-a752-9c0f6e8385a9 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.426038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:54.430134 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603f3d-9b95-499f-a752-9c0f6e8385a9 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.480943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f5d20-8b50-4d4f-b85f-79d3fe544d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.484003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f5d20-8b50-4d4f-b85f-79d3fe544d4f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.484314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f5d20-8b50-4d4f-b85f-79d3fe544d4f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.484590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f5d20-8b50-4d4f-b85f-79d3fe544d4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.500581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f5d20-8b50-4d4f-b85f-79d3fe544d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-e58f5d20-8b50-4d4f-b85f-79d3fe544d4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:54.508782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:54.510935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:42:54.512986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:54.519538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 235/483] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:54.519772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a0053-8467-4832-9a69-4009a5a31348 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.652131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a0053-8467-4832-9a69-4009a5a31348 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.702785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7fd33-19bf-44d2-9b76-a42a50294c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.703507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7fd33-19bf-44d2-9b76-a42a50294c9a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.703813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7fd33-19bf-44d2-9b76-a42a50294c9a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.704085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7fd33-19bf-44d2-9b76-a42a50294c9a None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.704830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7fd33-19bf-44d2-9b76-a42a50294c9a None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:54.705155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7fd33-19bf-44d2-9b76-a42a50294c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.706839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7fd33-19bf-44d2-9b76-a42a50294c9a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.719703 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 249/484] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:54.721899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f5d20-8b50-4d4f-b85f-79d3fe544d4f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.875775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f5d20-8b50-4d4f-b85f-79d3fe544d4f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.912194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89662d0-05e3-4beb-bcaf-8021868227aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.913034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89662d0-05e3-4beb-bcaf-8021868227aa None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.913315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89662d0-05e3-4beb-bcaf-8021868227aa None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.913587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89662d0-05e3-4beb-bcaf-8021868227aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.927423 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89662d0-05e3-4beb-bcaf-8021868227aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.929071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89662d0-05e3-4beb-bcaf-8021868227aa None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-a89662d0-05e3-4beb-bcaf-8021868227aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:54.949056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:54.949962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:54.950892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:54.950892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:54.950892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:54.950892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:54.954955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 236/485] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:54.956745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7fd33-19bf-44d2-9b76-a42a50294c9a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.970853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:55.073951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7fd33-19bf-44d2-9b76-a42a50294c9a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:55.122935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0adebc-4c79-41b0-a139-807e7e46ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:55.123785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0adebc-4c79-41b0-a139-807e7e46ea82 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.123949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0adebc-4c79-41b0-a139-807e7e46ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.124150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0adebc-4c79-41b0-a139-807e7e46ea82 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.124881 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0adebc-4c79-41b0-a139-807e7e46ea82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:55.125250 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0adebc-4c79-41b0-a139-807e7e46ea82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:55.126619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0adebc-4c79-41b0-a139-807e7e46ea82 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:55.140006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 250/486] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:55.145771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89662d0-05e3-4beb-bcaf-8021868227aa None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:55.171108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:55.193743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a02181-8fb6-45dd-8145-51033ec2d2d1 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.194397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a02181-8fb6-45dd-8145-51033ec2d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.194683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a02181-8fb6-45dd-8145-51033ec2d2d1 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.196727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 251/487] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:55.203434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d80d0-9643-48bf-b088-efb60820c465 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.203708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d80d0-9643-48bf-b088-efb60820c465 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.203947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d80d0-9643-48bf-b088-efb60820c465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.241453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f46d80d0-9643-48bf-b088-efb60820c465 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:55.242658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f46d80d0-9643-48bf-b088-efb60820c465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:55.297622 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89662d0-05e3-4beb-bcaf-8021868227aa None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:55.341659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ba36-6224-4a6a-9aef-71ff54e00aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:55.342482 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ba36-6224-4a6a-9aef-71ff54e00aed None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.342916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ba36-6224-4a6a-9aef-71ff54e00aed None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.343205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ba36-6224-4a6a-9aef-71ff54e00aed None admin] PATH_INFO: `/v3/users/nova` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.364837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ba36-6224-4a6a-9aef-71ff54e00aed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:55.366330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ba36-6224-4a6a-9aef-71ff54e00aed None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:55.374514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:55.384570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 252/488] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-7555ba36-6224-4a6a-9aef-71ff54e00aed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:42:55.397520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:55.399964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:55.402192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 237/489] 10.222.0.93 () {56 vars in 1093 bytes} [Thu May 26 16:42:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:55.411598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d80d0-9643-48bf-b088-efb60820c465 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:55.419165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ba36-6224-4a6a-9aef-71ff54e00aed None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:55.537038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d80d0-9643-48bf-b088-efb60820c465 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:55.579777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742c59-a8e4-439c-81db-90541f759b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:55.581455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742c59-a8e4-439c-81db-90541f759b69 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.581744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742c59-a8e4-439c-81db-90541f759b69 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.582022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742c59-a8e4-439c-81db-90541f759b69 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.582874 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742c59-a8e4-439c-81db-90541f759b69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:55.583184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742c59-a8e4-439c-81db-90541f759b69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:55.584667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742c59-a8e4-439c-81db-90541f759b69 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:55.630128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:55.663694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 253/490] 10.222.0.93 () {56 vars in 1133 bytes} [Thu May 26 16:42:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:55.677493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742c59-a8e4-439c-81db-90541f759b69 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:55.695543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ba36-6224-4a6a-9aef-71ff54e00aed None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:55.759787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97d8f9-32b0-4078-841a-836df3acfec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:55.760589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97d8f9-32b0-4078-841a-836df3acfec9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.760876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97d8f9-32b0-4078-841a-836df3acfec9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.761159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97d8f9-32b0-4078-841a-836df3acfec9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.782952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97d8f9-32b0-4078-841a-836df3acfec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9f97d8f9-32b0-4078-841a-836df3acfec9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:55.792582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:55.793505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:55.794376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 238/491] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:42:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:55.800346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97d8f9-32b0-4078-841a-836df3acfec9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:55.805653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:55.901663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742c59-a8e4-439c-81db-90541f759b69 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:55.929190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97d8f9-32b0-4078-841a-836df3acfec9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:55.953960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b9382-3add-4f52-9c98-ac8e023f5073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:55.954966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9382-3add-4f52-9c98-ac8e023f5073 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.955511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9382-3add-4f52-9c98-ac8e023f5073 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.956154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9382-3add-4f52-9c98-ac8e023f5073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.968618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:55.975800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62ce7f-53ae-4063-8331-0f2df66cf8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:55.976479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62ce7f-53ae-4063-8331-0f2df66cf8f4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.976764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62ce7f-53ae-4063-8331-0f2df66cf8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.977042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62ce7f-53ae-4063-8331-0f2df66cf8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:55.978086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62ce7f-53ae-4063-8331-0f2df66cf8f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:55.978397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62ce7f-53ae-4063-8331-0f2df66cf8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:55.980287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62ce7f-53ae-4063-8331-0f2df66cf8f4 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:55.992496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 239/492] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:42:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:55.999097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b960d5-155d-4935-a17a-4c1c13344434 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:55.999097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b960d5-155d-4935-a17a-4c1c13344434 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:55.999097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b960d5-155d-4935-a17a-4c1c13344434 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.002850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 240/493] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:56.004801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b960d5-155d-4935-a17a-4c1c13344434 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.045419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b9382-3add-4f52-9c98-ac8e023f5073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.046930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b9382-3add-4f52-9c98-ac8e023f5073 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.126152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.141362 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b960d5-155d-4935-a17a-4c1c13344434 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.175698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 254/494] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:42:56.181400 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788a208-a303-485d-b95e-7aceab51798b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.181714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788a208-a303-485d-b95e-7aceab51798b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.181971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788a208-a303-485d-b95e-7aceab51798b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.183232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ee47-9862-4922-a58b-769ba2ab447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.184093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ee47-9862-4922-a58b-769ba2ab447f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.184542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ee47-9862-4922-a58b-769ba2ab447f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.184820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ee47-9862-4922-a58b-769ba2ab447f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.196071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ee47-9862-4922-a58b-769ba2ab447f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.197616 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ee47-9862-4922-a58b-769ba2ab447f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.201232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b788a208-a303-485d-b95e-7aceab51798b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:56.202568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b788a208-a303-485d-b95e-7aceab51798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-1e15ee47-9862-4922-a58b-769ba2ab447f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:56.218336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:56.219358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:56.220386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:56.220386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:56.220386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:56.220386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:56.222070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 241/495] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:56.223717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a0c7d-6b3a-40c2-848a-f1728f967e8b None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.224167 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a0c7d-6b3a-40c2-848a-f1728f967e8b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.224570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a0c7d-6b3a-40c2-848a-f1728f967e8b None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.226008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 242/496] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:56.227275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a0c7d-6b3a-40c2-848a-f1728f967e8b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.281560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.288506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 255/497] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:56.289778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788a208-a303-485d-b95e-7aceab51798b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.353457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a0c7d-6b3a-40c2-848a-f1728f967e8b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.390200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8f07a-a5f0-4a76-a612-d9c1af3654fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.391003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f07a-a5f0-4a76-a612-d9c1af3654fe None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.391291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f07a-a5f0-4a76-a612-d9c1af3654fe None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.391608 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f07a-a5f0-4a76-a612-d9c1af3654fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.391886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.404734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8f07a-a5f0-4a76-a612-d9c1af3654fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.405226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788a208-a303-485d-b95e-7aceab51798b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.407928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8f07a-a5f0-4a76-a612-d9c1af3654fe None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-11a8f07a-a5f0-4a76-a612-d9c1af3654fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:56.425205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:56.426184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:56.427122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:56.427122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:56.427122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:56.427122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:56.427122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 243/498] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:56.427833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee7878-039b-478f-be48-8247effcd4fd None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.428108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee7878-039b-478f-be48-8247effcd4fd None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.428385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee7878-039b-478f-be48-8247effcd4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.445858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5fee7878-039b-478f-be48-8247effcd4fd None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:56.446568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1fdaf-c01c-4b18-bc05-b24ba14a151f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.447087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5fee7878-039b-478f-be48-8247effcd4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:56.447240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1fdaf-c01c-4b18-bc05-b24ba14a151f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.447519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1fdaf-c01c-4b18-bc05-b24ba14a151f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.447821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1fdaf-c01c-4b18-bc05-b24ba14a151f None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.448543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1fdaf-c01c-4b18-bc05-b24ba14a151f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:56.448847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1fdaf-c01c-4b18-bc05-b24ba14a151f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.450359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1fdaf-c01c-4b18-bc05-b24ba14a151f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.464212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 256/499] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:56.466174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e36f-aa3c-4417-a409-a5e189da629f None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.466884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e36f-aa3c-4417-a409-a5e189da629f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.467203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e36f-aa3c-4417-a409-a5e189da629f None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.468815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 257/500] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:42:56.469436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e36f-aa3c-4417-a409-a5e189da629f None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.532206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 244/501] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:56.533306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee7878-039b-478f-be48-8247effcd4fd None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.562644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.593259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e36f-aa3c-4417-a409-a5e189da629f None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.629736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c47e7-fe5b-4df5-bfbb-d981f5adcbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.630455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c47e7-fe5b-4df5-bfbb-d981f5adcbb8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.630737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c47e7-fe5b-4df5-bfbb-d981f5adcbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.631011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c47e7-fe5b-4df5-bfbb-d981f5adcbb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.642171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee7878-039b-478f-be48-8247effcd4fd None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.643066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c47e7-fe5b-4df5-bfbb-d981f5adcbb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-cc7c47e7-fe5b-4df5-bfbb-d981f5adcbb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:56.651174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:56.652202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 258/502] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:56.658706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c47e7-fe5b-4df5-bfbb-d981f5adcbb8 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.666947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.693686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8ed88-fdf2-49b1-9c8e-62b16072fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.694378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8ed88-fdf2-49b1-9c8e-62b16072fd95 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.694661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8ed88-fdf2-49b1-9c8e-62b16072fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.694934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8ed88-fdf2-49b1-9c8e-62b16072fd95 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.695725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8ed88-fdf2-49b1-9c8e-62b16072fd95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:56.696038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8ed88-fdf2-49b1-9c8e-62b16072fd95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.697530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8ed88-fdf2-49b1-9c8e-62b16072fd95 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.711433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 245/503] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:56.712518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d1cc-bba3-4d45-a306-571ad864093d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.712814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d1cc-bba3-4d45-a306-571ad864093d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.713096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d1cc-bba3-4d45-a306-571ad864093d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.730449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0c79d1cc-bba3-4d45-a306-571ad864093d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:56.731777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0c79d1cc-bba3-4d45-a306-571ad864093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:56.770034 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c47e7-fe5b-4df5-bfbb-d981f5adcbb8 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.806448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b1e81-310e-4336-ab02-97c0ff6678d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.807263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b1e81-310e-4336-ab02-97c0ff6678d7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.807497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 246/504] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:42:56.807898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b1e81-310e-4336-ab02-97c0ff6678d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.807898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b1e81-310e-4336-ab02-97c0ff6678d7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.808425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79d1cc-bba3-4d45-a306-571ad864093d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.822510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b1e81-310e-4336-ab02-97c0ff6678d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.824046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b1e81-310e-4336-ab02-97c0ff6678d7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:56.839075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-a78b1e81-310e-4336-ab02-97c0ff6678d7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:42:56.841967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:56.843381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:56.844649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 259/505] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:56.846682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b1e81-310e-4336-ab02-97c0ff6678d7 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.918296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:56.923786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79d1cc-bba3-4d45-a306-571ad864093d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.954148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b1e81-310e-4336-ab02-97c0ff6678d7 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:56.959693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26942e9d-bf3e-4d62-bcdf-05f2d7a98d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.960525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26942e9d-bf3e-4d62-bcdf-05f2d7a98d27 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.960800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26942e9d-bf3e-4d62-bcdf-05f2d7a98d27 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.965114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26942e9d-bf3e-4d62-bcdf-05f2d7a98d27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.972594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26942e9d-bf3e-4d62-bcdf-05f2d7a98d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-26942e9d-bf3e-4d62-bcdf-05f2d7a98d27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:42:56.980341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:56.981385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:56.982715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 247/506] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:56.983421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26942e9d-bf3e-4d62-bcdf-05f2d7a98d27 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:56.994810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b52e46-74c6-4a34-9b2b-6365cf4ae5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:56.995488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b52e46-74c6-4a34-9b2b-6365cf4ae5a9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:56.995806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b52e46-74c6-4a34-9b2b-6365cf4ae5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:56.996084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b52e46-74c6-4a34-9b2b-6365cf4ae5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:56.996835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b52e46-74c6-4a34-9b2b-6365cf4ae5a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:56.997143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b52e46-74c6-4a34-9b2b-6365cf4ae5a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:56.998581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b52e46-74c6-4a34-9b2b-6365cf4ae5a9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.007701 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 260/507] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:57.008539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b52e46-74c6-4a34-9b2b-6365cf4ae5a9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.062570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.086753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26942e9d-bf3e-4d62-bcdf-05f2d7a98d27 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.114779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b52e46-74c6-4a34-9b2b-6365cf4ae5a9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.120713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35a305-b157-4eae-85ad-b25709cee5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.121489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35a305-b157-4eae-85ad-b25709cee5b3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.121774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35a305-b157-4eae-85ad-b25709cee5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.122077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35a305-b157-4eae-85ad-b25709cee5b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.129582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35a305-b157-4eae-85ad-b25709cee5b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.131046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35a305-b157-4eae-85ad-b25709cee5b3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.143735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-2b35a305-b157-4eae-85ad-b25709cee5b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:42:57.146564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:57.147540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:57.148436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:42:57.148436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:42:57.148436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:42:57.148436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:42:57.148436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:42:57.148436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:42:57.148436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:42:57.148436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:57.148436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 248/508] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:57.148907 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35a305-b157-4eae-85ad-b25709cee5b3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.155299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da89615-e693-4f7c-8a1a-53a425fc3ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.156258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da89615-e693-4f7c-8a1a-53a425fc3ae6 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.156482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da89615-e693-4f7c-8a1a-53a425fc3ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.156760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da89615-e693-4f7c-8a1a-53a425fc3ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.168517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da89615-e693-4f7c-8a1a-53a425fc3ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.170033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da89615-e693-4f7c-8a1a-53a425fc3ae6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-6da89615-e693-4f7c-8a1a-53a425fc3ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:57.190186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:57.191305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:57.192372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:57.192372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:57.192372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:57.192372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:57.192372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 261/509] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:57.196561 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da89615-e693-4f7c-8a1a-53a425fc3ae6 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.262454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35a305-b157-4eae-85ad-b25709cee5b3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.298359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450ca2c-3a38-43c8-a511-5d07ff684032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.299025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450ca2c-3a38-43c8-a511-5d07ff684032 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.299306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450ca2c-3a38-43c8-a511-5d07ff684032 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.299609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450ca2c-3a38-43c8-a511-5d07ff684032 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.300438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450ca2c-3a38-43c8-a511-5d07ff684032 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:57.300742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450ca2c-3a38-43c8-a511-5d07ff684032 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.302216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450ca2c-3a38-43c8-a511-5d07ff684032 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.305508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da89615-e693-4f7c-8a1a-53a425fc3ae6 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.319979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.339721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 249/510] 10.222.0.93 () {56 vars in 1137 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:57.341106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450ca2c-3a38-43c8-a511-5d07ff684032 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.347060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccc33-525d-482a-91ae-e4ef07e1cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.347789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccc33-525d-482a-91ae-e4ef07e1cb70 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.348076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccc33-525d-482a-91ae-e4ef07e1cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.348353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccc33-525d-482a-91ae-e4ef07e1cb70 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.349104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ccc33-525d-482a-91ae-e4ef07e1cb70 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:57.349409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ccc33-525d-482a-91ae-e4ef07e1cb70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.350798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ccc33-525d-482a-91ae-e4ef07e1cb70 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.365039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 262/511] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:57.365039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccc33-525d-482a-91ae-e4ef07e1cb70 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.409540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.450199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450ca2c-3a38-43c8-a511-5d07ff684032 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.464850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccc33-525d-482a-91ae-e4ef07e1cb70 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.486294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d06c-ee69-4f2b-a188-107b6421b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.487079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d06c-ee69-4f2b-a188-107b6421b28f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.487357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d06c-ee69-4f2b-a188-107b6421b28f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.487691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d06c-ee69-4f2b-a188-107b6421b28f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.499342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018d06c-ee69-4f2b-a188-107b6421b28f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.500885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018d06c-ee69-4f2b-a188-107b6421b28f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.504345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005be4c4-e9f8-4052-9f54-fa36297e3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.505003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005be4c4-e9f8-4052-9f54-fa36297e3456 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.505284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005be4c4-e9f8-4052-9f54-fa36297e3456 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.505563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005be4c4-e9f8-4052-9f54-fa36297e3456 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.506345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005be4c4-e9f8-4052-9f54-fa36297e3456 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:57.506657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005be4c4-e9f8-4052-9f54-fa36297e3456 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.508143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005be4c4-e9f8-4052-9f54-fa36297e3456 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-e018d06c-ee69-4f2b-a188-107b6421b28f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:57.518919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:57.520102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:57.521413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:57.521413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:57.521413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:57.521413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:57.521413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 250/512] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:57.521413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d06c-ee69-4f2b-a188-107b6421b28f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.528119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 263/513] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:57.529770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005be4c4-e9f8-4052-9f54-fa36297e3456 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.579324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.634240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d06c-ee69-4f2b-a188-107b6421b28f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.640199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005be4c4-e9f8-4052-9f54-fa36297e3456 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.642972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.668748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10ec9-6a89-40b0-8bb7-2277bb738a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.669410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10ec9-6a89-40b0-8bb7-2277bb738a17 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.669688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10ec9-6a89-40b0-8bb7-2277bb738a17 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.669961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10ec9-6a89-40b0-8bb7-2277bb738a17 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.670683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e10ec9-6a89-40b0-8bb7-2277bb738a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:57.670988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e10ec9-6a89-40b0-8bb7-2277bb738a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.672464 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e10ec9-6a89-40b0-8bb7-2277bb738a17 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.679169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881699c-e1bd-40cd-81fc-b1d2203cba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.679864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881699c-e1bd-40cd-81fc-b1d2203cba9d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.680154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881699c-e1bd-40cd-81fc-b1d2203cba9d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.680435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881699c-e1bd-40cd-81fc-b1d2203cba9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.690484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 251/514] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:57.690484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10ec9-6a89-40b0-8bb7-2277bb738a17 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.755310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881699c-e1bd-40cd-81fc-b1d2203cba9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.756785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881699c-e1bd-40cd-81fc-b1d2203cba9d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.790226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10ec9-6a89-40b0-8bb7-2277bb738a17 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.799998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.824278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca6318-38ae-429d-93a2-0f8aaa56ae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.825068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca6318-38ae-429d-93a2-0f8aaa56ae22 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.825857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca6318-38ae-429d-93a2-0f8aaa56ae22 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.826152 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca6318-38ae-429d-93a2-0f8aaa56ae22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.836530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca6318-38ae-429d-93a2-0f8aaa56ae22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.838001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca6318-38ae-429d-93a2-0f8aaa56ae22 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-ebca6318-38ae-429d-93a2-0f8aaa56ae22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:57.856772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:57.859084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:57.860912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:57.860912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:57.860912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:57.860912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:57.860912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 252/515] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:57.860912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca6318-38ae-429d-93a2-0f8aaa56ae22 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.869283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 264/516] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:57.869283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881699c-e1bd-40cd-81fc-b1d2203cba9d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.871089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:57.969068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881699c-e1bd-40cd-81fc-b1d2203cba9d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.971529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca6318-38ae-429d-93a2-0f8aaa56ae22 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.001548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30564eaa-696d-44b8-8a05-f0c8774ea7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.002184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564eaa-696d-44b8-8a05-f0c8774ea7fa None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.002463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564eaa-696d-44b8-8a05-f0c8774ea7fa None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.002730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564eaa-696d-44b8-8a05-f0c8774ea7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.003543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30564eaa-696d-44b8-8a05-f0c8774ea7fa None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=8dd8a5a74a2947e385ca0cb7f3ee6428) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:58.003879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30564eaa-696d-44b8-8a05-f0c8774ea7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.004355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da273233-2d5f-4e03-9174-75eae72a0a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.005002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da273233-2d5f-4e03-9174-75eae72a0a29 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.005279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da273233-2d5f-4e03-9174-75eae72a0a29 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.005441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30564eaa-696d-44b8-8a05-f0c8774ea7fa None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.005580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da273233-2d5f-4e03-9174-75eae72a0a29 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.006287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da273233-2d5f-4e03-9174-75eae72a0a29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:58.006590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da273233-2d5f-4e03-9174-75eae72a0a29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.007990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da273233-2d5f-4e03-9174-75eae72a0a29 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.010913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 265/517] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/role_assignments?user.id=8dd8a5a74a2947e385ca0cb7f3ee6428&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:58.011696 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30564eaa-696d-44b8-8a05-f0c8774ea7fa None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.021762 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 253/518] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:58.022673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da273233-2d5f-4e03-9174-75eae72a0a29 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.048004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:58.106032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:58.144751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da273233-2d5f-4e03-9174-75eae72a0a29 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.147605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30564eaa-696d-44b8-8a05-f0c8774ea7fa None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.186381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785088d-6ec8-4f2b-bcdf-b3ce99b456d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.187062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785088d-6ec8-4f2b-bcdf-b3ce99b456d2 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.187236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae729d4-71dc-40e5-bbfc-01cf98c90b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.187345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785088d-6ec8-4f2b-bcdf-b3ce99b456d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.187620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785088d-6ec8-4f2b-bcdf-b3ce99b456d2 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.188122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae729d4-71dc-40e5-bbfc-01cf98c90b5c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.188333 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785088d-6ec8-4f2b-bcdf-b3ce99b456d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.188445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae729d4-71dc-40e5-bbfc-01cf98c90b5c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.188669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae729d4-71dc-40e5-bbfc-01cf98c90b5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.189790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785088d-6ec8-4f2b-bcdf-b3ce99b456d2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.202132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae729d4-71dc-40e5-bbfc-01cf98c90b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.203642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae729d4-71dc-40e5-bbfc-01cf98c90b5c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-aae729d4-71dc-40e5-bbfc-01cf98c90b5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:58.222842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:58.224084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:58.229707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:58.229707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:58.229707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:58.229707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:58.229707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 254/519] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:58.229707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae729d4-71dc-40e5-bbfc-01cf98c90b5c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.300709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:58.318420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 266/520] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:42:58 2022] POST /identity/v3/users => generated 247 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:58.319414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785088d-6ec8-4f2b-bcdf-b3ce99b456d2 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.343957 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae729d4-71dc-40e5-bbfc-01cf98c90b5c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.391428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b39ef5-d492-4579-acf9-7dddf2388c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.392526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b39ef5-d492-4579-acf9-7dddf2388c2c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.392953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b39ef5-d492-4579-acf9-7dddf2388c2c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.393708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b39ef5-d492-4579-acf9-7dddf2388c2c None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.395232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b39ef5-d492-4579-acf9-7dddf2388c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:58.395903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b39ef5-d492-4579-acf9-7dddf2388c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.398330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b39ef5-d492-4579-acf9-7dddf2388c2c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.413393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 255/521] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:58.414397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b39ef5-d492-4579-acf9-7dddf2388c2c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.452092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785088d-6ec8-4f2b-bcdf-b3ce99b456d2 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.483310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:58.500736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f923bbb-563e-49b8-8e38-b4cefa792d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.501725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f923bbb-563e-49b8-8e38-b4cefa792d8d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.502112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f923bbb-563e-49b8-8e38-b4cefa792d8d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.502487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f923bbb-563e-49b8-8e38-b4cefa792d8d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.512113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f923bbb-563e-49b8-8e38-b4cefa792d8d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.514115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f923bbb-563e-49b8-8e38-b4cefa792d8d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-2f923bbb-563e-49b8-8e38-b4cefa792d8d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:42:58.533357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:58.534485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:42:58.535477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:58.537124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 267/522] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:58.538312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f923bbb-563e-49b8-8e38-b4cefa792d8d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.558528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b39ef5-d492-4579-acf9-7dddf2388c2c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.600404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:58.607437 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6650a-7253-4164-946b-d8af54663e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.608259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6650a-7253-4164-946b-d8af54663e85 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.608549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6650a-7253-4164-946b-d8af54663e85 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.608831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6650a-7253-4164-946b-d8af54663e85 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.609564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6650a-7253-4164-946b-d8af54663e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:58.609874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6650a-7253-4164-946b-d8af54663e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.611261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6650a-7253-4164-946b-d8af54663e85 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.627941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 256/523] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:58.628893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6650a-7253-4164-946b-d8af54663e85 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.665109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f923bbb-563e-49b8-8e38-b4cefa792d8d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.717049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d502e13-2ed4-48dc-88ae-9a54c259f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.718269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d502e13-2ed4-48dc-88ae-9a54c259f3d3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.718763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d502e13-2ed4-48dc-88ae-9a54c259f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.719532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d502e13-2ed4-48dc-88ae-9a54c259f3d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.732806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d502e13-2ed4-48dc-88ae-9a54c259f3d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.735377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d502e13-2ed4-48dc-88ae-9a54c259f3d3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-0d502e13-2ed4-48dc-88ae-9a54c259f3d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:42:58.756404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:58.757465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:42:58.758379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:58.758895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6650a-7253-4164-946b-d8af54663e85 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.761971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 268/524] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:58.767818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d502e13-2ed4-48dc-88ae-9a54c259f3d3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.808869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00c275-5f07-4f16-b473-4ba8f2e40c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.809923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00c275-5f07-4f16-b473-4ba8f2e40c45 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.810417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00c275-5f07-4f16-b473-4ba8f2e40c45 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.810898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00c275-5f07-4f16-b473-4ba8f2e40c45 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.811994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00c275-5f07-4f16-b473-4ba8f2e40c45 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:58.812517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00c275-5f07-4f16-b473-4ba8f2e40c45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.814840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00c275-5f07-4f16-b473-4ba8f2e40c45 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.820975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:58.840581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 257/525] 10.222.0.93 () {56 vars in 1139 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:58.841824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00c275-5f07-4f16-b473-4ba8f2e40c45 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:58.900885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d502e13-2ed4-48dc-88ae-9a54c259f3d3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.905951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:58.953376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f028920-0adc-4228-933d-ff7967c7c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:58.954187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f028920-0adc-4228-933d-ff7967c7c6ba None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:58.954476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f028920-0adc-4228-933d-ff7967c7c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:58.954756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f028920-0adc-4228-933d-ff7967c7c6ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:58.965228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f028920-0adc-4228-933d-ff7967c7c6ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:58.967752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f028920-0adc-4228-933d-ff7967c7c6ba None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:58.972519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00c275-5f07-4f16-b473-4ba8f2e40c45 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-2f028920-0adc-4228-933d-ff7967c7c6ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:42:58.988900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:58.990002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:58.990921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:42:58.990921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:42:58.990921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:42:58.990921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:42:58.990921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:42:58.990921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:42:58.990921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:42:58.990921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:58.994865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 269/526] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:58.995720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f028920-0adc-4228-933d-ff7967c7c6ba None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.015376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a9953-e70a-43b6-b684-4eb074af5e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.016262 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a9953-e70a-43b6-b684-4eb074af5e91 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.016608 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a9953-e70a-43b6-b684-4eb074af5e91 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.016951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a9953-e70a-43b6-b684-4eb074af5e91 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.017963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a9953-e70a-43b6-b684-4eb074af5e91 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:59.018338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a9953-e70a-43b6-b684-4eb074af5e91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.019897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a9953-e70a-43b6-b684-4eb074af5e91 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.040514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 258/527] 10.222.0.93 () {56 vars in 1137 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:59.041542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a9953-e70a-43b6-b684-4eb074af5e91 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.101763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f028920-0adc-4228-933d-ff7967c7c6ba None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.104152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:59.139072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8b8ae-213a-4738-8047-76a6b3202eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.139751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8b8ae-213a-4738-8047-76a6b3202eaa None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.140033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8b8ae-213a-4738-8047-76a6b3202eaa None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.140307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8b8ae-213a-4738-8047-76a6b3202eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.154692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a9953-e70a-43b6-b684-4eb074af5e91 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.166004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:59.193735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3b42-b2c3-4f12-b406-07405d44f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.194509 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3b42-b2c3-4f12-b406-07405d44f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.194860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3b42-b2c3-4f12-b406-07405d44f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.195294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3b42-b2c3-4f12-b406-07405d44f5c3 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.196674 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3b42-b2c3-4f12-b406-07405d44f5c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:59.197279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3b42-b2c3-4f12-b406-07405d44f5c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.199684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3b42-b2c3-4f12-b406-07405d44f5c3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.220024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8b8ae-213a-4738-8047-76a6b3202eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.221498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8b8ae-213a-4738-8047-76a6b3202eaa None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.221802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 259/528] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:59.222708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3b42-b2c3-4f12-b406-07405d44f5c3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.342272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3b42-b2c3-4f12-b406-07405d44f5c3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.352624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 270/529] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:59.353548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8b8ae-213a-4738-8047-76a6b3202eaa None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.357328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:59.380995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4844a-d91d-43ac-aa50-bce66b82d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.382025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4844a-d91d-43ac-aa50-bce66b82d08c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.382508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4844a-d91d-43ac-aa50-bce66b82d08c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.383005 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4844a-d91d-43ac-aa50-bce66b82d08c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.426280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:59.462473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4844a-d91d-43ac-aa50-bce66b82d08c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.463912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8b8ae-213a-4738-8047-76a6b3202eaa None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.464085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4844a-d91d-43ac-aa50-bce66b82d08c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.501358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c4296-8184-4c1d-8e48-1c93aa9cf698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.502373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c4296-8184-4c1d-8e48-1c93aa9cf698 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.502873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c4296-8184-4c1d-8e48-1c93aa9cf698 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.503342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c4296-8184-4c1d-8e48-1c93aa9cf698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.504401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c4296-8184-4c1d-8e48-1c93aa9cf698 None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=4145a3bf87a94f4e9d39e16dc483595b) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:59.504936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c4296-8184-4c1d-8e48-1c93aa9cf698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.506568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c4296-8184-4c1d-8e48-1c93aa9cf698 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.519920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 271/530] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/role_assignments?user.id=4145a3bf87a94f4e9d39e16dc483595b&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:59.521395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c4296-8184-4c1d-8e48-1c93aa9cf698 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.574281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 260/531] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:42:59.583592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4844a-d91d-43ac-aa50-bce66b82d08c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.678385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:59.699989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:59.740320 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c4296-8184-4c1d-8e48-1c93aa9cf698 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.777712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4844a-d91d-43ac-aa50-bce66b82d08c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:59.814017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c7ec0-060e-4a56-925a-41d53570eeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.815403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c7ec0-060e-4a56-925a-41d53570eeca None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.815936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c7ec0-060e-4a56-925a-41d53570eeca None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.816428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c7ec0-060e-4a56-925a-41d53570eeca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.832800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cadd9-6935-42ba-9ae8-7eff0a4fffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:59.833042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c7ec0-060e-4a56-925a-41d53570eeca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.834064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cadd9-6935-42ba-9ae8-7eff0a4fffff None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:59.834064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cadd9-6935-42ba-9ae8-7eff0a4fffff None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:59.834227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cadd9-6935-42ba-9ae8-7eff0a4fffff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:59.836106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c7ec0-060e-4a56-925a-41d53570eeca None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.847541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cadd9-6935-42ba-9ae8-7eff0a4fffff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:59.849118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cadd9-6935-42ba-9ae8-7eff0a4fffff None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-d17c7ec0-060e-4a56-925a-41d53570eeca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:59.856227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:59.857162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:59.858028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:59.858028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:59.858028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:59.858028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:42:59.860341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 272/532] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-dc3cadd9-6935-42ba-9ae8-7eff0a4fffff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:42:59.868373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:42:59.869313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:42:59.870987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:42:59.870987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:42:59.870987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:42:59.870987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:42:59.871253 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c7ec0-060e-4a56-925a-41d53570eeca None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.871330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 261/533] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:42:59.876284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cadd9-6935-42ba-9ae8-7eff0a4fffff None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:59.986526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cadd9-6935-42ba-9ae8-7eff0a4fffff None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.026616 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88712e2-49bb-451d-8ec6-db8c46e57f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.027366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88712e2-49bb-451d-8ec6-db8c46e57f22 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.027710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88712e2-49bb-451d-8ec6-db8c46e57f22 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.028055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88712e2-49bb-451d-8ec6-db8c46e57f22 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.028769 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88712e2-49bb-451d-8ec6-db8c46e57f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:00.029081 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88712e2-49bb-451d-8ec6-db8c46e57f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.033442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:00.035874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88712e2-49bb-451d-8ec6-db8c46e57f22 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.056106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 262/534] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:00.064458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88712e2-49bb-451d-8ec6-db8c46e57f22 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:00.160051 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c7ec0-060e-4a56-925a-41d53570eeca None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.203449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:00.234518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078c666-bb54-48f7-8401-7f835d8a891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.235290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078c666-bb54-48f7-8401-7f835d8a891d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.235473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078c666-bb54-48f7-8401-7f835d8a891d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.235787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078c666-bb54-48f7-8401-7f835d8a891d None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.236524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078c666-bb54-48f7-8401-7f835d8a891d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:00.236883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078c666-bb54-48f7-8401-7f835d8a891d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.238265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078c666-bb54-48f7-8401-7f835d8a891d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.265449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 273/535] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:00.272347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078c666-bb54-48f7-8401-7f835d8a891d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:00.292359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88712e2-49bb-451d-8ec6-db8c46e57f22 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.366199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b235d-0419-4540-82d3-4a9b2f9f9e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.366997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b235d-0419-4540-82d3-4a9b2f9f9e53 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.367280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b235d-0419-4540-82d3-4a9b2f9f9e53 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.367553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b235d-0419-4540-82d3-4a9b2f9f9e53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.379747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b235d-0419-4540-82d3-4a9b2f9f9e53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.381390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b235d-0419-4540-82d3-4a9b2f9f9e53 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-f09b235d-0419-4540-82d3-4a9b2f9f9e53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:00.396747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:00.397687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:00.398772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:00.398772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:00.398772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:00.398772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:00.398772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:00.398772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:00.398772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:00.398772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:00.398772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 263/536] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:00.408606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b235d-0419-4540-82d3-4a9b2f9f9e53 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:00.445151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078c666-bb54-48f7-8401-7f835d8a891d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.468840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:00.487472 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe29ed-2215-43a4-8b25-72d7a3df1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.488524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe29ed-2215-43a4-8b25-72d7a3df1854 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.488976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe29ed-2215-43a4-8b25-72d7a3df1854 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.489390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe29ed-2215-43a4-8b25-72d7a3df1854 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.498061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe29ed-2215-43a4-8b25-72d7a3df1854 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.499867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe29ed-2215-43a4-8b25-72d7a3df1854 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-cabe29ed-2215-43a4-8b25-72d7a3df1854 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:00.516810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:00.517911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:00.518795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:00.518795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:00.518795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:00.518795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:00.518795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:00.518795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:00.518795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:00.518795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:00.521163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 274/537] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:00.522758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243057e6-9f83-4c2d-be86-f24a0c17fc70 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.523169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243057e6-9f83-4c2d-be86-f24a0c17fc70 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.523603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243057e6-9f83-4c2d-be86-f24a0c17fc70 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.525068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 275/538] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:00.527239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243057e6-9f83-4c2d-be86-f24a0c17fc70 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:00.536372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b235d-0419-4540-82d3-4a9b2f9f9e53 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.573527 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21db1d3-2f86-48f0-aebb-7dd8083b22eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.574187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db1d3-2f86-48f0-aebb-7dd8083b22eb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.574468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db1d3-2f86-48f0-aebb-7dd8083b22eb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.574741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db1d3-2f86-48f0-aebb-7dd8083b22eb None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.576209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21db1d3-2f86-48f0-aebb-7dd8083b22eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:00.576522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21db1d3-2f86-48f0-aebb-7dd8083b22eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.578206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21db1d3-2f86-48f0-aebb-7dd8083b22eb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.579878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:00.591678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 264/539] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:00.593263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddbc48-11f9-4728-ba90-6bee9b635e94 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.593559 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddbc48-11f9-4728-ba90-6bee9b635e94 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.593835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddbc48-11f9-4728-ba90-6bee9b635e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.612485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-16ddbc48-11f9-4728-ba90-6bee9b635e94 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:00.613437 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-16ddbc48-11f9-4728-ba90-6bee9b635e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:00.650428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243057e6-9f83-4c2d-be86-f24a0c17fc70 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.692262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d749c-571a-4c08-b1f4-a21f168f20f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.693489 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d749c-571a-4c08-b1f4-a21f168f20f7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.693929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d749c-571a-4c08-b1f4-a21f168f20f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.694336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d749c-571a-4c08-b1f4-a21f168f20f7 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.695300 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d749c-571a-4c08-b1f4-a21f168f20f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:00.695778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d749c-571a-4c08-b1f4-a21f168f20f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.697427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d749c-571a-4c08-b1f4-a21f168f20f7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.702197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 265/540] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:00.703397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddbc48-11f9-4728-ba90-6bee9b635e94 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:00.715150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 276/541] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:00.725102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d749c-571a-4c08-b1f4-a21f168f20f7 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:00.752818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:00.837113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddbc48-11f9-4728-ba90-6bee9b635e94 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.840624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:00.844303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d749c-571a-4c08-b1f4-a21f168f20f7 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.880887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c636dd-938f-428e-a25e-70ab01209876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.881629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c636dd-938f-428e-a25e-70ab01209876 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.881910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c636dd-938f-428e-a25e-70ab01209876 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.882183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c636dd-938f-428e-a25e-70ab01209876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.883032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c636dd-938f-428e-a25e-70ab01209876 None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=68cb539d18194ce6a0ad60f206699d78) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:00.883607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c636dd-938f-428e-a25e-70ab01209876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.884920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c636dd-938f-428e-a25e-70ab01209876 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.888867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692acb0-8184-421d-abb2-1aa725549bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.889534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692acb0-8184-421d-abb2-1aa725549bfe None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.889819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692acb0-8184-421d-abb2-1aa725549bfe None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.890101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692acb0-8184-421d-abb2-1aa725549bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.890951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692acb0-8184-421d-abb2-1aa725549bfe None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=8fee665c10364944a8162548f91a431e) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:00.891286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692acb0-8184-421d-abb2-1aa725549bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.899882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 266/542] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:00 2022] GET /identity/v3/role_assignments?user.id=68cb539d18194ce6a0ad60f206699d78&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:00.900081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692acb0-8184-421d-abb2-1aa725549bfe None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.900160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c636dd-938f-428e-a25e-70ab01209876 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:00.907913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 277/543] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:00 2022] GET /identity/v3/role_assignments?user.id=8fee665c10364944a8162548f91a431e&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:00.909920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910e6ac-b4ba-45d8-98fa-9f9645845a2b None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.909920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910e6ac-b4ba-45d8-98fa-9f9645845a2b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.910449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910e6ac-b4ba-45d8-98fa-9f9645845a2b None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.912324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 278/544] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:00.918547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e73331-0e36-44b4-9993-b4e937caa5be None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.918902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e73331-0e36-44b4-9993-b4e937caa5be None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.919126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e73331-0e36-44b4-9993-b4e937caa5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.955911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c3e73331-0e36-44b4-9993-b4e937caa5be None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:00.957215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c3e73331-0e36-44b4-9993-b4e937caa5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:01.114394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:01.121727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c636dd-938f-428e-a25e-70ab01209876 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:01.133542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 279/545] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:43:01.181326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e73331-0e36-44b4-9993-b4e937caa5be None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:01.193400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef03815-943c-45c1-b5fb-037e63fb8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:01.194214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03815-943c-45c1-b5fb-037e63fb8ffd None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:01.194496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03815-943c-45c1-b5fb-037e63fb8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:01.194770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03815-943c-45c1-b5fb-037e63fb8ffd None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:01.226504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef03815-943c-45c1-b5fb-037e63fb8ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-0ef03815-943c-45c1-b5fb-037e63fb8ffd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:01.243770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:01.244829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:01.246253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 267/546] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:01.251513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef03815-943c-45c1-b5fb-037e63fb8ffd None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:01.314315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:01.324918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e73331-0e36-44b4-9993-b4e937caa5be None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:01.369146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4930d7-b753-436d-94ab-c276698ee44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:01.371479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4930d7-b753-436d-94ab-c276698ee44a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:01.371814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4930d7-b753-436d-94ab-c276698ee44a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:01.372097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4930d7-b753-436d-94ab-c276698ee44a None admin] PATH_INFO: `/v3/roles/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:01.394253 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4930d7-b753-436d-94ab-c276698ee44a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-6a4930d7-b753-436d-94ab-c276698ee44a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:01.406840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:01.408359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:01.409962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 280/547] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:01.414688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4930d7-b753-436d-94ab-c276698ee44a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:01.520009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef03815-943c-45c1-b5fb-037e63fb8ffd None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:01.530895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4930d7-b753-436d-94ab-c276698ee44a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:01.571696 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd922a-0614-4d05-9ef2-80fce477bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:01.572526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd922a-0614-4d05-9ef2-80fce477bc09 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:01.572818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd922a-0614-4d05-9ef2-80fce477bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:01.573094 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd922a-0614-4d05-9ef2-80fce477bc09 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:01.573855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd922a-0614-4d05-9ef2-80fce477bc09 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:01.574171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd922a-0614-4d05-9ef2-80fce477bc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:01.576248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd922a-0614-4d05-9ef2-80fce477bc09 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:01.586788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 281/548] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:01.593604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd922a-0614-4d05-9ef2-80fce477bc09 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:01.620040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:01.629981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a53b98-7360-4550-8e61-a1022c4b95f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:01.631321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a53b98-7360-4550-8e61-a1022c4b95f6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:01.631717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a53b98-7360-4550-8e61-a1022c4b95f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:01.632006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a53b98-7360-4550-8e61-a1022c4b95f6 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:01.638938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a53b98-7360-4550-8e61-a1022c4b95f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:01.638938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a53b98-7360-4550-8e61-a1022c4b95f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:01.638938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a53b98-7360-4550-8e61-a1022c4b95f6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:01.645082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 268/549] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:01.651801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a53b98-7360-4550-8e61-a1022c4b95f6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:01.692300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:01.793117 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a53b98-7360-4550-8e61-a1022c4b95f6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:01.835380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34907afa-8bcf-416c-a305-03088084108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:01.836465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907afa-8bcf-416c-a305-03088084108a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:01.836831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907afa-8bcf-416c-a305-03088084108a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:01.837119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907afa-8bcf-416c-a305-03088084108a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:01.852399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34907afa-8bcf-416c-a305-03088084108a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:01.854222 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34907afa-8bcf-416c-a305-03088084108a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-34907afa-8bcf-416c-a305-03088084108a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:01.878690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:01.879939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:01.881014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:01.881014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:01.881014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:01.881014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:01.883043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 269/550] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:01.889137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34907afa-8bcf-416c-a305-03088084108a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:01.957441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd922a-0614-4d05-9ef2-80fce477bc09 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.014374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:02.051466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb16cc3-5b71-4145-b4ce-f7defc078a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.052964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb16cc3-5b71-4145-b4ce-f7defc078a51 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.054627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb16cc3-5b71-4145-b4ce-f7defc078a51 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.055299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb16cc3-5b71-4145-b4ce-f7defc078a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.088600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb16cc3-5b71-4145-b4ce-f7defc078a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.091258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb16cc3-5b71-4145-b4ce-f7defc078a51 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.101040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34907afa-8bcf-416c-a305-03088084108a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-dbb16cc3-5b71-4145-b4ce-f7defc078a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:02.121974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:02.123629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:02.124923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:02.124923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:02.124923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:02.124923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:02.128618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 282/551] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 535 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:02.134443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb16cc3-5b71-4145-b4ce-f7defc078a51 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.159983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468a0b7-80ae-4400-a645-a9f783cf86bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.161034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468a0b7-80ae-4400-a645-a9f783cf86bd None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.161517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468a0b7-80ae-4400-a645-a9f783cf86bd None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.162061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468a0b7-80ae-4400-a645-a9f783cf86bd None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.163029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468a0b7-80ae-4400-a645-a9f783cf86bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:02.163551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468a0b7-80ae-4400-a645-a9f783cf86bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.166487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468a0b7-80ae-4400-a645-a9f783cf86bd None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.192736 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 270/552] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:02.201433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468a0b7-80ae-4400-a645-a9f783cf86bd None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.328660 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:02.405228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468a0b7-80ae-4400-a645-a9f783cf86bd None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.422017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb16cc3-5b71-4145-b4ce-f7defc078a51 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.464959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:02.477042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d972d36-1a61-4276-af21-012fb1d50720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.486402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d972d36-1a61-4276-af21-012fb1d50720 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.486402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d972d36-1a61-4276-af21-012fb1d50720 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.486402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d972d36-1a61-4276-af21-012fb1d50720 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.486655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4456d3-de55-4f48-a9b9-8003cd6f82d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.486655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4456d3-de55-4f48-a9b9-8003cd6f82d3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.486655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4456d3-de55-4f48-a9b9-8003cd6f82d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.486655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4456d3-de55-4f48-a9b9-8003cd6f82d3 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.487179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4456d3-de55-4f48-a9b9-8003cd6f82d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:02.487553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4456d3-de55-4f48-a9b9-8003cd6f82d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.489664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4456d3-de55-4f48-a9b9-8003cd6f82d3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.494975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d972d36-1a61-4276-af21-012fb1d50720 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.496777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d972d36-1a61-4276-af21-012fb1d50720 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.505397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 283/553] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:02.506898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1ba23-a2cf-4b53-b4f1-3818273250d2 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.507296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1ba23-a2cf-4b53-b4f1-3818273250d2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.507683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1ba23-a2cf-4b53-b4f1-3818273250d2 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.513602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 284/554] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:02.513602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1ba23-a2cf-4b53-b4f1-3818273250d2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-8d972d36-1a61-4276-af21-012fb1d50720 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:02.520741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:02.522417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:02.523390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:02.530566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 271/555] 10.222.0.93 () {56 vars in 1093 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:02.532724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e765021-5abb-4aba-b443-3a207e95c8ff None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.533278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e765021-5abb-4aba-b443-3a207e95c8ff None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.533736 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e765021-5abb-4aba-b443-3a207e95c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.553911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5e765021-5abb-4aba-b443-3a207e95c8ff None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:02.555624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5e765021-5abb-4aba-b443-3a207e95c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:02.636085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1ba23-a2cf-4b53-b4f1-3818273250d2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.649945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 272/556] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:02.651462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e765021-5abb-4aba-b443-3a207e95c8ff None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.667163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:02.681627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61499eb0-0ceb-4114-b3f2-a82ebe095a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.682576 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61499eb0-0ceb-4114-b3f2-a82ebe095a2d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.682913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61499eb0-0ceb-4114-b3f2-a82ebe095a2d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.683135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61499eb0-0ceb-4114-b3f2-a82ebe095a2d None admin] PATH_INFO: `/v3/users/swift` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.697991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61499eb0-0ceb-4114-b3f2-a82ebe095a2d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.699347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61499eb0-0ceb-4114-b3f2-a82ebe095a2d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-61499eb0-0ceb-4114-b3f2-a82ebe095a2d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:02.722395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:02.723407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:02.724904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 285/557] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:02.731272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61499eb0-0ceb-4114-b3f2-a82ebe095a2d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.786595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e765021-5abb-4aba-b443-3a207e95c8ff None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.811025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:02.833061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d29e0-6a3f-4554-b369-a6020ffc9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.834074 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d29e0-6a3f-4554-b369-a6020ffc9aaa None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.834238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d29e0-6a3f-4554-b369-a6020ffc9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.834621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d29e0-6a3f-4554-b369-a6020ffc9aaa None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.835538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d29e0-6a3f-4554-b369-a6020ffc9aaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:02.835989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d29e0-6a3f-4554-b369-a6020ffc9aaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:02.837606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d29e0-6a3f-4554-b369-a6020ffc9aaa None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:02.859219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61499eb0-0ceb-4114-b3f2-a82ebe095a2d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.862970 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 273/558] 10.222.0.93 () {56 vars in 1133 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:02.863154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d29e0-6a3f-4554-b369-a6020ffc9aaa None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.906025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e18bc-829e-4912-b18d-dfe36f3939cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.906831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e18bc-829e-4912-b18d-dfe36f3939cd None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.908187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e18bc-829e-4912-b18d-dfe36f3939cd None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.908187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e18bc-829e-4912-b18d-dfe36f3939cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:02.920203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e18bc-829e-4912-b18d-dfe36f3939cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-731e18bc-829e-4912-b18d-dfe36f3939cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:02.927876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:02.929030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:02.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 286/559] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:02.930649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e18bc-829e-4912-b18d-dfe36f3939cd None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.019368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.063990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d29e0-6a3f-4554-b369-a6020ffc9aaa None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.086989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e18bc-829e-4912-b18d-dfe36f3939cd None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.112964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0ec46-852f-48a8-b775-e0a9a26fd21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.113811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0ec46-852f-48a8-b775-e0a9a26fd21b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.114096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0ec46-852f-48a8-b775-e0a9a26fd21b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.114375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0ec46-852f-48a8-b775-e0a9a26fd21b None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.115221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0ec46-852f-48a8-b775-e0a9a26fd21b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:03.115584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0ec46-852f-48a8-b775-e0a9a26fd21b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.117571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0ec46-852f-48a8-b775-e0a9a26fd21b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.135611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ed91d-150e-402c-91d9-3de86460b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.137509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ed91d-150e-402c-91d9-3de86460b19e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.138850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ed91d-150e-402c-91d9-3de86460b19e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.139362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ed91d-150e-402c-91d9-3de86460b19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.145561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 274/560] 10.222.0.93 () {56 vars in 1135 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:03.145561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0ec46-852f-48a8-b775-e0a9a26fd21b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.158678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ed91d-150e-402c-91d9-3de86460b19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.160056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ed91d-150e-402c-91d9-3de86460b19e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-887ed91d-150e-402c-91d9-3de86460b19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:03.179493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:03.180548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:03.181463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:03.181463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:03.181463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:03.181463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:03.181463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 287/561] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:03.182441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ed91d-150e-402c-91d9-3de86460b19e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.194516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.287391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0ec46-852f-48a8-b775-e0a9a26fd21b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.340632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.343641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c304bb3-102f-494c-a700-ef5bc232d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.344660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c304bb3-102f-494c-a700-ef5bc232d6fb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.344806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ed91d-150e-402c-91d9-3de86460b19e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.345324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c304bb3-102f-494c-a700-ef5bc232d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.345799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c304bb3-102f-494c-a700-ef5bc232d6fb None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.347132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c304bb3-102f-494c-a700-ef5bc232d6fb None admin] RBAC: Adding query filter params (name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:03.348701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c304bb3-102f-494c-a700-ef5bc232d6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.350504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c304bb3-102f-494c-a700-ef5bc232d6fb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.362953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 275/562] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:03.364335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c304bb3-102f-494c-a700-ef5bc232d6fb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.389647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341930fb-971c-4a95-83e3-8d60ec855372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.391520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341930fb-971c-4a95-83e3-8d60ec855372 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.392189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341930fb-971c-4a95-83e3-8d60ec855372 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.392780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341930fb-971c-4a95-83e3-8d60ec855372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.482030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341930fb-971c-4a95-83e3-8d60ec855372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.483746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341930fb-971c-4a95-83e3-8d60ec855372 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.493298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.502354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c304bb3-102f-494c-a700-ef5bc232d6fb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.550131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5fc43-3da2-4942-9ac0-a5d9096e5593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.550788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5fc43-3da2-4942-9ac0-a5d9096e5593 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.551085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5fc43-3da2-4942-9ac0-a5d9096e5593 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.551358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5fc43-3da2-4942-9ac0-a5d9096e5593 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.552118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5fc43-3da2-4942-9ac0-a5d9096e5593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:03.552447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5fc43-3da2-4942-9ac0-a5d9096e5593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.553886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5fc43-3da2-4942-9ac0-a5d9096e5593 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.571467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 276/563] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:03.572539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5fc43-3da2-4942-9ac0-a5d9096e5593 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.602122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.606634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 288/564] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:43:03.608004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377c905-9eff-4c52-b417-6de999859e68 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.608293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377c905-9eff-4c52-b417-6de999859e68 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.608571 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377c905-9eff-4c52-b417-6de999859e68 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.611639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 289/565] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:03.611639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015d11-5641-4b3f-aaa5-ba3a61a08ab6 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.611639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015d11-5641-4b3f-aaa5-ba3a61a08ab6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.611941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015d11-5641-4b3f-aaa5-ba3a61a08ab6 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.613790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 290/566] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:03.613790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015d11-5641-4b3f-aaa5-ba3a61a08ab6 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.685848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5fc43-3da2-4942-9ac0-a5d9096e5593 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.723006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e9ea-0041-4a99-b155-657f66eae0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.723816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e9ea-0041-4a99-b155-657f66eae0ef None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.724102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e9ea-0041-4a99-b155-657f66eae0ef None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.724376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e9ea-0041-4a99-b155-657f66eae0ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.725411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015d11-5641-4b3f-aaa5-ba3a61a08ab6 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.735416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e9ea-0041-4a99-b155-657f66eae0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.736825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e9ea-0041-4a99-b155-657f66eae0ef None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9f14e9ea-0041-4a99-b155-657f66eae0ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:03.760934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:03.762105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:03.763686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:03.763686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:03.763686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:03.763686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:03.763686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 277/567] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:03.763979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e9ea-0041-4a99-b155-657f66eae0ef None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:03.768806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1ef6-0763-4499-91bf-369a5e39a937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.769612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1ef6-0763-4499-91bf-369a5e39a937 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.769900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1ef6-0763-4499-91bf-369a5e39a937 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.770174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1ef6-0763-4499-91bf-369a5e39a937 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.776095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.781610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa1ef6-0763-4499-91bf-369a5e39a937 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.784263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa1ef6-0763-4499-91bf-369a5e39a937 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-daaa1ef6-0763-4499-91bf-369a5e39a937 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:03.802527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:03.803821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 291/568] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4062cd-8379-4467-a090-1f2d798fa7c8 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.815608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4062cd-8379-4467-a090-1f2d798fa7c8 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.816441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4062cd-8379-4467-a090-1f2d798fa7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.835388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-2c4062cd-8379-4467-a090-1f2d798fa7c8 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:03.836644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2c4062cd-8379-4467-a090-1f2d798fa7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:03.879202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e9ea-0041-4a99-b155-657f66eae0ef None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:03.902661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.914226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 292/569] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:03.917029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4be99-c1cf-4537-b189-795b6186e5d1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.917165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb6ae9-598f-4d03-901e-0ab9cc3cc0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:03.917671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4be99-c1cf-4537-b189-795b6186e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.917890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb6ae9-598f-4d03-901e-0ab9cc3cc0dc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:03.918196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb6ae9-598f-4d03-901e-0ab9cc3cc0dc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:03.918479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb6ae9-598f-4d03-901e-0ab9cc3cc0dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.918771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4be99-c1cf-4537-b189-795b6186e5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.935950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb6ae9-598f-4d03-901e-0ab9cc3cc0dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.937434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb6ae9-598f-4d03-901e-0ab9cc3cc0dc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.943050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1ba4be99-c1cf-4537-b189-795b6186e5d1 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:03.944287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1ba4be99-c1cf-4537-b189-795b6186e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-b9eb6ae9-598f-4d03-901e-0ab9cc3cc0dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:03.955927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:03.956909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:03.964124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:03.964124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:03.964124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:03.964124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:03.964124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 278/570] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:03.964124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb6ae9-598f-4d03-901e-0ab9cc3cc0dc None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.020431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.026255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 293/571] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:04.027123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4be99-c1cf-4537-b189-795b6186e5d1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.069783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb6ae9-598f-4d03-901e-0ab9cc3cc0dc None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.106055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ec20-8722-4bef-9e5e-3d2ca6042311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.107239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ec20-8722-4bef-9e5e-3d2ca6042311 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.107521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ec20-8722-4bef-9e5e-3d2ca6042311 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.107827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ec20-8722-4bef-9e5e-3d2ca6042311 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.108559 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ec20-8722-4bef-9e5e-3d2ca6042311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:04.108861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ec20-8722-4bef-9e5e-3d2ca6042311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.110269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ec20-8722-4bef-9e5e-3d2ca6042311 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.127696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 279/572] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:04.133452 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ec20-8722-4bef-9e5e-3d2ca6042311 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.136327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4be99-c1cf-4537-b189-795b6186e5d1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.156526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.175224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466fe7a-6aa7-4571-a1c7-4b544911e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.176006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466fe7a-6aa7-4571-a1c7-4b544911e3f7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.176235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466fe7a-6aa7-4571-a1c7-4b544911e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.176490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466fe7a-6aa7-4571-a1c7-4b544911e3f7 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.178369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466fe7a-6aa7-4571-a1c7-4b544911e3f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:04.178680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466fe7a-6aa7-4571-a1c7-4b544911e3f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.180154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466fe7a-6aa7-4571-a1c7-4b544911e3f7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.193275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 294/573] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:04.194117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466fe7a-6aa7-4571-a1c7-4b544911e3f7 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.247078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ec20-8722-4bef-9e5e-3d2ca6042311 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.269298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.285081 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbcae0-c4e0-427f-9b8d-2e284e04f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.285795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbcae0-c4e0-427f-9b8d-2e284e04f28b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.286079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbcae0-c4e0-427f-9b8d-2e284e04f28b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.286354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbcae0-c4e0-427f-9b8d-2e284e04f28b None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.297929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbcae0-c4e0-427f-9b8d-2e284e04f28b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:04.305904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466fe7a-6aa7-4571-a1c7-4b544911e3f7 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-78cbcae0-c4e0-427f-9b8d-2e284e04f28b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:04.306232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:04.307354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:04.308270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 280/574] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:04.308997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbcae0-c4e0-427f-9b8d-2e284e04f28b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.343856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2589024-08b7-483c-a858-b77888f0d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.344605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2589024-08b7-483c-a858-b77888f0d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.344894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2589024-08b7-483c-a858-b77888f0d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.345169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2589024-08b7-483c-a858-b77888f0d5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.345881 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2589024-08b7-483c-a858-b77888f0d5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:04.346183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2589024-08b7-483c-a858-b77888f0d5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.347548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2589024-08b7-483c-a858-b77888f0d5c8 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.360658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 295/575] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:04.361478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2589024-08b7-483c-a858-b77888f0d5c8 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.404378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.410015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbcae0-c4e0-427f-9b8d-2e284e04f28b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.444544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534312-d91c-4077-97f6-1c9a48b57232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.445337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534312-d91c-4077-97f6-1c9a48b57232 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.445624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534312-d91c-4077-97f6-1c9a48b57232 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.445902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534312-d91c-4077-97f6-1c9a48b57232 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.457069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f534312-d91c-4077-97f6-1c9a48b57232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:04.463604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2589024-08b7-483c-a858-b77888f0d5c8 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-1f534312-d91c-4077-97f6-1c9a48b57232 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:04.464773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:04.465842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 281/576] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:04.467343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534312-d91c-4077-97f6-1c9a48b57232 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.503960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8c54-4d7d-4906-b43a-37abb8b53464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.504748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8c54-4d7d-4906-b43a-37abb8b53464 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.505033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8c54-4d7d-4906-b43a-37abb8b53464 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.505297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8c54-4d7d-4906-b43a-37abb8b53464 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.512732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d8c54-4d7d-4906-b43a-37abb8b53464 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.513143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.514282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d8c54-4d7d-4906-b43a-37abb8b53464 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-183d8c54-4d7d-4906-b43a-37abb8b53464 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:04.529509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:04.530712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:04.532145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 296/577] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:04.534546 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8c54-4d7d-4906-b43a-37abb8b53464 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.575153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534312-d91c-4077-97f6-1c9a48b57232 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.612876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0c80-ca2a-4b4f-babb-6372e71178fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.613851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0c80-ca2a-4b4f-babb-6372e71178fb None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.614230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0c80-ca2a-4b4f-babb-6372e71178fb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.614594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0c80-ca2a-4b4f-babb-6372e71178fb None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/8dd8a5a74a2947e385ca0cb7f3ee6428/roles/a13a3c6af2864ff1848ccbb2da56273e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.632440 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e0c80-ca2a-4b4f-babb-6372e71178fb None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=8dd8a5a74a2947e385ca0cb7f3ee6428, role_id=a13a3c6af2864ff1848ccbb2da56273e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.633920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e0c80-ca2a-4b4f-babb-6372e71178fb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.649069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.652384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8c54-4d7d-4906-b43a-37abb8b53464 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.690395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318460b-c499-481c-b8d1-4f714fb5274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.691069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318460b-c499-481c-b8d1-4f714fb5274a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.691375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318460b-c499-481c-b8d1-4f714fb5274a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.691679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318460b-c499-481c-b8d1-4f714fb5274a None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.692450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318460b-c499-481c-b8d1-4f714fb5274a None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:04.701063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318460b-c499-481c-b8d1-4f714fb5274a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.701063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318460b-c499-481c-b8d1-4f714fb5274a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.705370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 297/578] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:04.706220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318460b-c499-481c-b8d1-4f714fb5274a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.731058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 282/579] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:43:04 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/8dd8a5a74a2947e385ca0cb7f3ee6428/roles/a13a3c6af2864ff1848ccbb2da56273e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:04.732009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0c80-ca2a-4b4f-babb-6372e71178fb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.866882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318460b-c499-481c-b8d1-4f714fb5274a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.874968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.888759 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0c80-ca2a-4b4f-babb-6372e71178fb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:04.906855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758e16-c577-43e7-bf5d-b4fd2e4e699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.907798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758e16-c577-43e7-bf5d-b4fd2e4e699c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.908078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758e16-c577-43e7-bf5d-b4fd2e4e699c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.908351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758e16-c577-43e7-bf5d-b4fd2e4e699c None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.918634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758e16-c577-43e7-bf5d-b4fd2e4e699c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.920224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758e16-c577-43e7-bf5d-b4fd2e4e699c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-b0758e16-c577-43e7-bf5d-b4fd2e4e699c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:04.937549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:04.938511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:04.939545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:04.939545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:04.939545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:04.939545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:04.939545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:04.939545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:04.939545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:04.939545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:04.939545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 298/580] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:04.940134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758e16-c577-43e7-bf5d-b4fd2e4e699c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:04.963925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b39dcf-7ac3-4976-a054-5808db8b54b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:04.964966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b39dcf-7ac3-4976-a054-5808db8b54b9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:04.965501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b39dcf-7ac3-4976-a054-5808db8b54b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:04.966358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:04.966839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b39dcf-7ac3-4976-a054-5808db8b54b9 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:04.968233 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b39dcf-7ac3-4976-a054-5808db8b54b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:04.968752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b39dcf-7ac3-4976-a054-5808db8b54b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:04.970395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b39dcf-7ac3-4976-a054-5808db8b54b9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:04.981838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 283/581] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:04.982950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b39dcf-7ac3-4976-a054-5808db8b54b9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.056901 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758e16-c577-43e7-bf5d-b4fd2e4e699c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.098416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bccee5-4f94-4563-a057-6dffc38ecdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.099100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bccee5-4f94-4563-a057-6dffc38ecdcf None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.099399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bccee5-4f94-4563-a057-6dffc38ecdcf None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.099704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bccee5-4f94-4563-a057-6dffc38ecdcf None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.100556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bccee5-4f94-4563-a057-6dffc38ecdcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:05.100870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bccee5-4f94-4563-a057-6dffc38ecdcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.102344 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bccee5-4f94-4563-a057-6dffc38ecdcf None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:05.124591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 299/582] 10.222.0.93 () {56 vars in 1137 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:05.125395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bccee5-4f94-4563-a057-6dffc38ecdcf None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.132078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b39dcf-7ac3-4976-a054-5808db8b54b9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.180810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd160b5-9a3f-4627-97af-77622b8629f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.181599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd160b5-9a3f-4627-97af-77622b8629f8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.181901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd160b5-9a3f-4627-97af-77622b8629f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.182152 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd160b5-9a3f-4627-97af-77622b8629f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.195136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd160b5-9a3f-4627-97af-77622b8629f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.196657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd160b5-9a3f-4627-97af-77622b8629f8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-dfd160b5-9a3f-4627-97af-77622b8629f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:05.218575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:05.219645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:05.220617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:05.220617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:05.220617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:05.220617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:05.220617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 284/583] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:05.220617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd160b5-9a3f-4627-97af-77622b8629f8 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.231212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:05.248534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:05.278131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bccee5-4f94-4563-a057-6dffc38ecdcf None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.335291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d089c-4979-4333-a29f-f22d50a70d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.336496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d089c-4979-4333-a29f-f22d50a70d42 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.336996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d089c-4979-4333-a29f-f22d50a70d42 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.337440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d089c-4979-4333-a29f-f22d50a70d42 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.338305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d089c-4979-4333-a29f-f22d50a70d42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:05.338663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d089c-4979-4333-a29f-f22d50a70d42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.341309 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d089c-4979-4333-a29f-f22d50a70d42 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:05.367132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 300/584] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:05.367132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d089c-4979-4333-a29f-f22d50a70d42 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.386360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd160b5-9a3f-4627-97af-77622b8629f8 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.428263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6991-ff04-4c50-ae14-2517a10aae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.429622 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6991-ff04-4c50-ae14-2517a10aae9a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.430082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6991-ff04-4c50-ae14-2517a10aae9a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.430409 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6991-ff04-4c50-ae14-2517a10aae9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.444132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb6991-ff04-4c50-ae14-2517a10aae9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.445599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb6991-ff04-4c50-ae14-2517a10aae9a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-27bb6991-ff04-4c50-ae14-2517a10aae9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:05.466328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:05.467378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:05.469266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:05.469266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:05.469266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:05.469266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:05.469266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 285/585] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:05.469266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6991-ff04-4c50-ae14-2517a10aae9a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.509582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d089c-4979-4333-a29f-f22d50a70d42 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.542102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:05.550375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dc11f-d797-4efa-95e0-07caed037ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.551267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dc11f-d797-4efa-95e0-07caed037ba7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.551658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dc11f-d797-4efa-95e0-07caed037ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.558109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dc11f-d797-4efa-95e0-07caed037ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.564787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:05.567416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dc11f-d797-4efa-95e0-07caed037ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.569725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dc11f-d797-4efa-95e0-07caed037ba7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-d57dc11f-d797-4efa-95e0-07caed037ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:05.588174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:05.589795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:05.591732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:05.591732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:05.591732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:05.591732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:05.591732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 301/586] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:05.591732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dc11f-d797-4efa-95e0-07caed037ba7 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.604499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6991-ff04-4c50-ae14-2517a10aae9a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.648856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476981-c5b2-4b5f-8581-4ceb128ad397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.649451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476981-c5b2-4b5f-8581-4ceb128ad397 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.649749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476981-c5b2-4b5f-8581-4ceb128ad397 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.650020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476981-c5b2-4b5f-8581-4ceb128ad397 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.650757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476981-c5b2-4b5f-8581-4ceb128ad397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:05.651061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476981-c5b2-4b5f-8581-4ceb128ad397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.652480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476981-c5b2-4b5f-8581-4ceb128ad397 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:05.667664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 286/587] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:05.668666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476981-c5b2-4b5f-8581-4ceb128ad397 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.716857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dc11f-d797-4efa-95e0-07caed037ba7 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.756464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189f6d2-fa0e-49b4-a1e1-15b438b8de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.757219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189f6d2-fa0e-49b4-a1e1-15b438b8de43 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.757572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189f6d2-fa0e-49b4-a1e1-15b438b8de43 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.757910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189f6d2-fa0e-49b4-a1e1-15b438b8de43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.758840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189f6d2-fa0e-49b4-a1e1-15b438b8de43 None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=45cfc967b8634e60b3ddfe4168a748b4) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:05.759217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189f6d2-fa0e-49b4-a1e1-15b438b8de43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.760775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189f6d2-fa0e-49b4-a1e1-15b438b8de43 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:05.767520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 302/588] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:05 2022] GET /identity/v3/role_assignments?user.id=45cfc967b8634e60b3ddfe4168a748b4&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:05.776738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189f6d2-fa0e-49b4-a1e1-15b438b8de43 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.799224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476981-c5b2-4b5f-8581-4ceb128ad397 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.832481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:05.863678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002753a-85f4-4987-93b1-f9904a248cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.864764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:05.866531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002753a-85f4-4987-93b1-f9904a248cb3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.867122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002753a-85f4-4987-93b1-f9904a248cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.867930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002753a-85f4-4987-93b1-f9904a248cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.870017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002753a-85f4-4987-93b1-f9904a248cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:05.870629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002753a-85f4-4987-93b1-f9904a248cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.873860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002753a-85f4-4987-93b1-f9904a248cb3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:05.897487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 287/589] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:05.899014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002753a-85f4-4987-93b1-f9904a248cb3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:05.940174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189f6d2-fa0e-49b4-a1e1-15b438b8de43 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:05.988464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8812fb-feec-43a4-856f-fe96771358d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:05.989415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8812fb-feec-43a4-856f-fe96771358d0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:05.989855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8812fb-feec-43a4-856f-fe96771358d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:05.990432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8812fb-feec-43a4-856f-fe96771358d0 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:05.991333 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8812fb-feec-43a4-856f-fe96771358d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:05.991680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8812fb-feec-43a4-856f-fe96771358d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:05.993214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8812fb-feec-43a4-856f-fe96771358d0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:06.006810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 303/590] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:06.007705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8812fb-feec-43a4-856f-fe96771358d0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:06.031274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002753a-85f4-4987-93b1-f9904a248cb3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:06.075128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342c858-fdc6-44d9-af53-550739d8063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:06.077741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342c858-fdc6-44d9-af53-550739d8063d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:06.078564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342c858-fdc6-44d9-af53-550739d8063d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:06.079302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342c858-fdc6-44d9-af53-550739d8063d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:06.094200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342c858-fdc6-44d9-af53-550739d8063d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:06.096192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342c858-fdc6-44d9-af53-550739d8063d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-6342c858-fdc6-44d9-af53-550739d8063d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:06.114033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:06.115065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:43:06.116200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:06.118971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 288/591] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:06.120122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342c858-fdc6-44d9-af53-550739d8063d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:06.137571 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8812fb-feec-43a4-856f-fe96771358d0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:06.159404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:06.169957 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:06.182182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186541b-7983-46f4-abef-2956c727a568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:06.183254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186541b-7983-46f4-abef-2956c727a568 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:06.183548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186541b-7983-46f4-abef-2956c727a568 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:06.183848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186541b-7983-46f4-abef-2956c727a568 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:06.194025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186541b-7983-46f4-abef-2956c727a568 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:06.195085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186541b-7983-46f4-abef-2956c727a568 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-b186541b-7983-46f4-abef-2956c727a568 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:06.219468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:06.222915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 304/592] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:06.224636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186541b-7983-46f4-abef-2956c727a568 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:06.284569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342c858-fdc6-44d9-af53-550739d8063d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:06.329162 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa74c37-3e22-42e0-982c-f7f1e7e54e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:06.330136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa74c37-3e22-42e0-982c-f7f1e7e54e6f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:06.330584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa74c37-3e22-42e0-982c-f7f1e7e54e6f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:06.330925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa74c37-3e22-42e0-982c-f7f1e7e54e6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:06.341002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa74c37-3e22-42e0-982c-f7f1e7e54e6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:06.344201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa74c37-3e22-42e0-982c-f7f1e7e54e6f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:06.349533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186541b-7983-46f4-abef-2956c727a568 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-3fa74c37-3e22-42e0-982c-f7f1e7e54e6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:06.360886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:06.362707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 289/593] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:06.364888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa74c37-3e22-42e0-982c-f7f1e7e54e6f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:06.396871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3106c-95c3-49c5-9d48-2babd39f6b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:06.397643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3106c-95c3-49c5-9d48-2babd39f6b3d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:06.397998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3106c-95c3-49c5-9d48-2babd39f6b3d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:06.398336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3106c-95c3-49c5-9d48-2babd39f6b3d None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:06.399434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3106c-95c3-49c5-9d48-2babd39f6b3d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:06.399820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3106c-95c3-49c5-9d48-2babd39f6b3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:06.401330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3106c-95c3-49c5-9d48-2babd39f6b3d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:06.424351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 305/594] 10.222.0.93 () {56 vars in 1139 bytes} [Thu May 26 16:43:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:06.425261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3106c-95c3-49c5-9d48-2babd39f6b3d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:06.474554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:06.492827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:06.499818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa74c37-3e22-42e0-982c-f7f1e7e54e6f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:06.543261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99aff1b-b64d-49ac-9937-d6762746cfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:06.544863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99aff1b-b64d-49ac-9937-d6762746cfe1 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:06.545393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99aff1b-b64d-49ac-9937-d6762746cfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:06.545868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99aff1b-b64d-49ac-9937-d6762746cfe1 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:06.547029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99aff1b-b64d-49ac-9937-d6762746cfe1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:06.547526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99aff1b-b64d-49ac-9937-d6762746cfe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:06.549380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99aff1b-b64d-49ac-9937-d6762746cfe1 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:06.560563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3106c-95c3-49c5-9d48-2babd39f6b3d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:06.577618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 290/595] 10.222.0.93 () {56 vars in 1137 bytes} [Thu May 26 16:43:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:06.579187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99aff1b-b64d-49ac-9937-d6762746cfe1 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:06.617852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0bb3b-08af-458b-b669-1a6aa8bb3c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:06.618857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0bb3b-08af-458b-b669-1a6aa8bb3c96 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:06.619266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0bb3b-08af-458b-b669-1a6aa8bb3c96 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:06.619702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0bb3b-08af-458b-b669-1a6aa8bb3c96 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:06.621528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0bb3b-08af-458b-b669-1a6aa8bb3c96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:06.622057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0bb3b-08af-458b-b669-1a6aa8bb3c96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:06.624966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0bb3b-08af-458b-b669-1a6aa8bb3c96 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:06.652004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 306/596] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:06.654354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0bb3b-08af-458b-b669-1a6aa8bb3c96 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:06.793034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99aff1b-b64d-49ac-9937-d6762746cfe1 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:06.826010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:06.836276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0bb3b-08af-458b-b669-1a6aa8bb3c96 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:06.866214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4331a-b030-43c0-a446-481ff868c5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:06.869320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4331a-b030-43c0-a446-481ff868c5bc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:06.869785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4331a-b030-43c0-a446-481ff868c5bc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:06.870236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4331a-b030-43c0-a446-481ff868c5bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:06.893910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4331a-b030-43c0-a446-481ff868c5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:06.896052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4331a-b030-43c0-a446-481ff868c5bc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:06.904082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b5a96-b30b-43b7-ae4f-909eaa91f270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:06.905347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5a96-b30b-43b7-ae4f-909eaa91f270 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:06.906495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5a96-b30b-43b7-ae4f-909eaa91f270 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:06.906966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5a96-b30b-43b7-ae4f-909eaa91f270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-84b4331a-b030-43c0-a446-481ff868c5bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:06.919902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:06.920946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:06.922070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:06.922070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:06.922070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:06.922070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:06.925375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 291/597] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:06.927123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4331a-b030-43c0-a446-481ff868c5bc None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:06.931151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b5a96-b30b-43b7-ae4f-909eaa91f270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:06.933427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b5a96-b30b-43b7-ae4f-909eaa91f270 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:06.948676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-121b5a96-b30b-43b7-ae4f-909eaa91f270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:06.974319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:06.975427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:06.976431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:06.976431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:06.976431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:06.976431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:06.976431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 307/598] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:06.982217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b5a96-b30b-43b7-ae4f-909eaa91f270 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.081726 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4331a-b030-43c0-a446-481ff868c5bc None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.110883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b5a96-b30b-43b7-ae4f-909eaa91f270 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.130324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3ccac-75ff-486e-86d8-a7beb8666b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.131257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3ccac-75ff-486e-86d8-a7beb8666b4d None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.131498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3ccac-75ff-486e-86d8-a7beb8666b4d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.131801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3ccac-75ff-486e-86d8-a7beb8666b4d None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/4145a3bf87a94f4e9d39e16dc483595b/roles/a13a3c6af2864ff1848ccbb2da56273e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.148988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3ccac-75ff-486e-86d8-a7beb8666b4d None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=4145a3bf87a94f4e9d39e16dc483595b, role_id=a13a3c6af2864ff1848ccbb2da56273e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.150451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3ccac-75ff-486e-86d8-a7beb8666b4d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.155008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a93f7-5ae1-468d-a437-21163adbb569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.155774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a93f7-5ae1-468d-a437-21163adbb569 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.156058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a93f7-5ae1-468d-a437-21163adbb569 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.156384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a93f7-5ae1-468d-a437-21163adbb569 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.157164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a93f7-5ae1-468d-a437-21163adbb569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:07.157475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a93f7-5ae1-468d-a437-21163adbb569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.158864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a93f7-5ae1-468d-a437-21163adbb569 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.171729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 308/599] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:07.172596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a93f7-5ae1-468d-a437-21163adbb569 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.182089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:07.259214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 292/600] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:43:06 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/4145a3bf87a94f4e9d39e16dc483595b/roles/a13a3c6af2864ff1848ccbb2da56273e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:07.259214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8607346-3327-4587-a95f-0ee817cab51e None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.259214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8607346-3327-4587-a95f-0ee817cab51e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.259214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8607346-3327-4587-a95f-0ee817cab51e None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.259214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 293/601] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:07.259214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8607346-3327-4587-a95f-0ee817cab51e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.316117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a93f7-5ae1-468d-a437-21163adbb569 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.344328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:07.367060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2ccee-35d6-4cb9-8194-a53aec1c9e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.367930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2ccee-35d6-4cb9-8194-a53aec1c9e98 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.368882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2ccee-35d6-4cb9-8194-a53aec1c9e98 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.369165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2ccee-35d6-4cb9-8194-a53aec1c9e98 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.369997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2ccee-35d6-4cb9-8194-a53aec1c9e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:07.370219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2ccee-35d6-4cb9-8194-a53aec1c9e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.372119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2ccee-35d6-4cb9-8194-a53aec1c9e98 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.390181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 309/602] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:07.391648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601231-6869-4a16-9056-a4f7943507d2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.397560 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601231-6869-4a16-9056-a4f7943507d2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.397560 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601231-6869-4a16-9056-a4f7943507d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.415218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8607346-3327-4587-a95f-0ee817cab51e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.424453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-63601231-6869-4a16-9056-a4f7943507d2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:07.426680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-63601231-6869-4a16-9056-a4f7943507d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:07.461746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12503b72-f770-4ffb-9e07-09fcb02bbab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.462843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503b72-f770-4ffb-9e07-09fcb02bbab8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.463315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503b72-f770-4ffb-9e07-09fcb02bbab8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.463828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503b72-f770-4ffb-9e07-09fcb02bbab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.477235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12503b72-f770-4ffb-9e07-09fcb02bbab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.479295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12503b72-f770-4ffb-9e07-09fcb02bbab8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-12503b72-f770-4ffb-9e07-09fcb02bbab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:07.498030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:07.499116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:07.500198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:07.500198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:07.500198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:07.500198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:07.500198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:07.500198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:07.500198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:07.500198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:07.500198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 294/603] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:07.500854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12503b72-f770-4ffb-9e07-09fcb02bbab8 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.517766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:07.526900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 310/604] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:07.527835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63601231-6869-4a16-9056-a4f7943507d2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.643534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12503b72-f770-4ffb-9e07-09fcb02bbab8 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.665842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:07.696715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63601231-6869-4a16-9056-a4f7943507d2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.698899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54488229-f8e4-4a84-a337-effc80f26211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.700489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54488229-f8e4-4a84-a337-effc80f26211 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.700489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54488229-f8e4-4a84-a337-effc80f26211 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.700489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54488229-f8e4-4a84-a337-effc80f26211 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.707731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54488229-f8e4-4a84-a337-effc80f26211 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.710058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54488229-f8e4-4a84-a337-effc80f26211 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-54488229-f8e4-4a84-a337-effc80f26211 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:07.726751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:07.727953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:07.729077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:07.729077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:07.729077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:07.729077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:07.729077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:07.729077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:07.729077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:07.729077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:07.730578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 295/605] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:07.732067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54488229-f8e4-4a84-a337-effc80f26211 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.751498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a8d45-59af-4025-80e1-7447184fb6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.752481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a8d45-59af-4025-80e1-7447184fb6f5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.752762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a8d45-59af-4025-80e1-7447184fb6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.753035 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a8d45-59af-4025-80e1-7447184fb6f5 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.754082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a8d45-59af-4025-80e1-7447184fb6f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:07.754393 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a8d45-59af-4025-80e1-7447184fb6f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.756289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a8d45-59af-4025-80e1-7447184fb6f5 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.774231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 311/606] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:07.775038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a8d45-59af-4025-80e1-7447184fb6f5 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.842398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:07.852977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54488229-f8e4-4a84-a337-effc80f26211 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.889581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a8d45-59af-4025-80e1-7447184fb6f5 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.891933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32c8c2-438c-4225-bfd8-72b11d754b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.892891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32c8c2-438c-4225-bfd8-72b11d754b6b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.893182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32c8c2-438c-4225-bfd8-72b11d754b6b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.893461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32c8c2-438c-4225-bfd8-72b11d754b6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.906808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32c8c2-438c-4225-bfd8-72b11d754b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-8b32c8c2-438c-4225-bfd8-72b11d754b6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:07.915697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:07.916716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:07.917575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 296/607] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:07.918934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32c8c2-438c-4225-bfd8-72b11d754b6b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.932196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2c2d9-91b1-4ed5-96e5-fab8beb1fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.932871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2c2d9-91b1-4ed5-96e5-fab8beb1fba5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.933154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2c2d9-91b1-4ed5-96e5-fab8beb1fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.933432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2c2d9-91b1-4ed5-96e5-fab8beb1fba5 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.934226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2c2d9-91b1-4ed5-96e5-fab8beb1fba5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:07.934550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2c2d9-91b1-4ed5-96e5-fab8beb1fba5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.936654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2c2d9-91b1-4ed5-96e5-fab8beb1fba5 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.956272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 312/608] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:07.957296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2c2d9-91b1-4ed5-96e5-fab8beb1fba5 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.962840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:08.052541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32c8c2-438c-4225-bfd8-72b11d754b6b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.071195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2c2d9-91b1-4ed5-96e5-fab8beb1fba5 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.090506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:08.092490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47a40-4af6-49ad-82d4-664221607ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.093603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47a40-4af6-49ad-82d4-664221607ad6 None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.094072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47a40-4af6-49ad-82d4-664221607ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.094553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47a40-4af6-49ad-82d4-664221607ad6 None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/8fee665c10364944a8162548f91a431e/roles/a13a3c6af2864ff1848ccbb2da56273e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.111177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de47a40-4af6-49ad-82d4-664221607ad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=8fee665c10364944a8162548f91a431e, role_id=a13a3c6af2864ff1848ccbb2da56273e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.111376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f6162-3fa1-4fee-a72b-0f82f0aecec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.112134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f6162-3fa1-4fee-a72b-0f82f0aecec1 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.112682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f6162-3fa1-4fee-a72b-0f82f0aecec1 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.113066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f6162-3fa1-4fee-a72b-0f82f0aecec1 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.113758 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de47a40-4af6-49ad-82d4-664221607ad6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:08.113930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f6162-3fa1-4fee-a72b-0f82f0aecec1 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:08.116047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f6162-3fa1-4fee-a72b-0f82f0aecec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.117750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f6162-3fa1-4fee-a72b-0f82f0aecec1 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:08.135969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 313/609] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:08.135969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f6162-3fa1-4fee-a72b-0f82f0aecec1 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:08.257405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 297/610] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:43:07 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/8fee665c10364944a8162548f91a431e/roles/a13a3c6af2864ff1848ccbb2da56273e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:08.258908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47a40-4af6-49ad-82d4-664221607ad6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:08.263459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f6162-3fa1-4fee-a72b-0f82f0aecec1 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.317879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef220d2-37ba-42f2-bde6-453ac736ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.318716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef220d2-37ba-42f2-bde6-453ac736ea90 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.318999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef220d2-37ba-42f2-bde6-453ac736ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.319272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef220d2-37ba-42f2-bde6-453ac736ea90 None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/68cb539d18194ce6a0ad60f206699d78/roles/a13a3c6af2864ff1848ccbb2da56273e` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.342238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef220d2-37ba-42f2-bde6-453ac736ea90 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=68cb539d18194ce6a0ad60f206699d78, role_id=a13a3c6af2864ff1848ccbb2da56273e)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.344655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef220d2-37ba-42f2-bde6-453ac736ea90 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:08.379604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:08.396590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47a40-4af6-49ad-82d4-664221607ad6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.443589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5755fbe-d57e-432f-a228-5f2cb67af20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.443589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755fbe-d57e-432f-a228-5f2cb67af20e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.443589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755fbe-d57e-432f-a228-5f2cb67af20e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.443589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755fbe-d57e-432f-a228-5f2cb67af20e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.444612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 314/611] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:43:08 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/68cb539d18194ce6a0ad60f206699d78/roles/a13a3c6af2864ff1848ccbb2da56273e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:08.447176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bde287-a727-41c7-9726-fe985a5d5385 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.447828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bde287-a727-41c7-9726-fe985a5d5385 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.448327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bde287-a727-41c7-9726-fe985a5d5385 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.457084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 315/612] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:08.462926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5755fbe-d57e-432f-a228-5f2cb67af20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.463784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc819f7-0fb4-4a2c-8976-52a5b4c3eeee None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.464283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc819f7-0fb4-4a2c-8976-52a5b4c3eeee None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.464571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5755fbe-d57e-432f-a228-5f2cb67af20e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:08.465012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc819f7-0fb4-4a2c-8976-52a5b4c3eeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.493335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5fc819f7-0fb4-4a2c-8976-52a5b4c3eeee None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:08.494910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5fc819f7-0fb4-4a2c-8976-52a5b4c3eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:08.535373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:08.608459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 316/613] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:43:08.647665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc819f7-0fb4-4a2c-8976-52a5b4c3eeee None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-e5755fbe-d57e-432f-a228-5f2cb67af20e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:08.662236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:08.663215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:08.664208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:08.664208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:08.664208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:08.664208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:08.664208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 298/614] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:08.674244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5755fbe-d57e-432f-a228-5f2cb67af20e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:08.810459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc819f7-0fb4-4a2c-8976-52a5b4c3eeee None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.861541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b976dd-0d3e-4bec-ab91-560d63c3922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.862341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b976dd-0d3e-4bec-ab91-560d63c3922f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.862630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b976dd-0d3e-4bec-ab91-560d63c3922f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.864615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b976dd-0d3e-4bec-ab91-560d63c3922f None admin] PATH_INFO: `/v3/roles/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.870912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5755fbe-d57e-432f-a228-5f2cb67af20e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.895986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b976dd-0d3e-4bec-ab91-560d63c3922f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-32b976dd-0d3e-4bec-ab91-560d63c3922f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:08.921663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:08.922910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:08.923867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 317/615] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:08.932796 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b976dd-0d3e-4bec-ab91-560d63c3922f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:08.965500 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a817-693c-4f30-92d0-5f4eecd9fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.966505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a817-693c-4f30-92d0-5f4eecd9fb04 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.966860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a817-693c-4f30-92d0-5f4eecd9fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.971050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a817-693c-4f30-92d0-5f4eecd9fb04 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.971998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544a817-693c-4f30-92d0-5f4eecd9fb04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:08.972312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544a817-693c-4f30-92d0-5f4eecd9fb04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.975044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:08.977480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544a817-693c-4f30-92d0-5f4eecd9fb04 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.000080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:09.005051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 299/616] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:09.010051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a817-693c-4f30-92d0-5f4eecd9fb04 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.118690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b976dd-0d3e-4bec-ab91-560d63c3922f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.168404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f082c-f0f2-4058-bfe1-fe844d4cc203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.169998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f082c-f0f2-4058-bfe1-fe844d4cc203 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.170283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f082c-f0f2-4058-bfe1-fe844d4cc203 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.170561 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f082c-f0f2-4058-bfe1-fe844d4cc203 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.171321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f082c-f0f2-4058-bfe1-fe844d4cc203 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:09.171678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f082c-f0f2-4058-bfe1-fe844d4cc203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.174017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f082c-f0f2-4058-bfe1-fe844d4cc203 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.186271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 318/617] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:09.193042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f082c-f0f2-4058-bfe1-fe844d4cc203 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.275476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a817-693c-4f30-92d0-5f4eecd9fb04 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.333309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898ab1-d6e7-4bfe-8fa7-d60b27f07fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.334688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898ab1-d6e7-4bfe-8fa7-d60b27f07fb2 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.335150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898ab1-d6e7-4bfe-8fa7-d60b27f07fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.335647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898ab1-d6e7-4bfe-8fa7-d60b27f07fb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.351057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46898ab1-d6e7-4bfe-8fa7-d60b27f07fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.352981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46898ab1-d6e7-4bfe-8fa7-d60b27f07fb2 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-46898ab1-d6e7-4bfe-8fa7-d60b27f07fb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:09.386275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:09.387275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:09.388327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:09.395614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 300/618] 10.222.0.93 () {56 vars in 1093 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:09.396696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898ab1-d6e7-4bfe-8fa7-d60b27f07fb2 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.399658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:09.447508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f082c-f0f2-4058-bfe1-fe844d4cc203 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.518227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2c32a-a8b9-42b1-8021-7895ca82102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.520669 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c32a-a8b9-42b1-8021-7895ca82102a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.521187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c32a-a8b9-42b1-8021-7895ca82102a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.521634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c32a-a8b9-42b1-8021-7895ca82102a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.544791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2c32a-a8b9-42b1-8021-7895ca82102a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.546909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2c32a-a8b9-42b1-8021-7895ca82102a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-7aa2c32a-a8b9-42b1-8021-7895ca82102a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:09.577430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:09.579671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:09.581710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:09.581710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:09.581710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:09.581710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:09.581710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 319/619] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:09.589251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2c32a-a8b9-42b1-8021-7895ca82102a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.599967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:09.679670 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898ab1-d6e7-4bfe-8fa7-d60b27f07fb2 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.735493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745507a-c437-4a9e-b5ad-bc3eb9839ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.736124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745507a-c437-4a9e-b5ad-bc3eb9839ef5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.736403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745507a-c437-4a9e-b5ad-bc3eb9839ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.736677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745507a-c437-4a9e-b5ad-bc3eb9839ef5 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.737528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745507a-c437-4a9e-b5ad-bc3eb9839ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:09.737832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745507a-c437-4a9e-b5ad-bc3eb9839ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.739324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745507a-c437-4a9e-b5ad-bc3eb9839ef5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.781976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 301/620] 10.222.0.93 () {56 vars in 1133 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:09.788783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745507a-c437-4a9e-b5ad-bc3eb9839ef5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.832094 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2c32a-a8b9-42b1-8021-7895ca82102a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.893885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:09.900398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5aaf4-1ee3-4c26-bcb9-61efaa4ab0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.901080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5aaf4-1ee3-4c26-bcb9-61efaa4ab0f2 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.901365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5aaf4-1ee3-4c26-bcb9-61efaa4ab0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.901690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5aaf4-1ee3-4c26-bcb9-61efaa4ab0f2 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.902368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5aaf4-1ee3-4c26-bcb9-61efaa4ab0f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:09.902679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5aaf4-1ee3-4c26-bcb9-61efaa4ab0f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.904143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5aaf4-1ee3-4c26-bcb9-61efaa4ab0f2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.936364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 320/621] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:09.942921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b0315-c509-4dd0-a542-ab736ac845ca None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.943290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b0315-c509-4dd0-a542-ab736ac845ca None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.943477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b0315-c509-4dd0-a542-ab736ac845ca None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.945149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 321/622] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:09.945900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b0315-c509-4dd0-a542-ab736ac845ca None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.000628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745507a-c437-4a9e-b5ad-bc3eb9839ef5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.020318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.041094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a43474-af90-43d8-83b6-c3d0199c7958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.042130 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a43474-af90-43d8-83b6-c3d0199c7958 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.042624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a43474-af90-43d8-83b6-c3d0199c7958 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.043210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a43474-af90-43d8-83b6-c3d0199c7958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.075482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b0315-c509-4dd0-a542-ab736ac845ca None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.114608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7187c0-8af1-4aed-a0ef-03d3abb053e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.115409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7187c0-8af1-4aed-a0ef-03d3abb053e9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.115727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7187c0-8af1-4aed-a0ef-03d3abb053e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.116011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7187c0-8af1-4aed-a0ef-03d3abb053e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.124930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7187c0-8af1-4aed-a0ef-03d3abb053e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.125456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a43474-af90-43d8-83b6-c3d0199c7958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.126437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7187c0-8af1-4aed-a0ef-03d3abb053e9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.127550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a43474-af90-43d8-83b6-c3d0199c7958 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-8a7187c0-8af1-4aed-a0ef-03d3abb053e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:10.146019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:10.147049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:10.148020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:10.148573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 322/623] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:10.153705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f85b-216d-49c3-b8e9-dd92874344bb None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.153705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f85b-216d-49c3-b8e9-dd92874344bb None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.153705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f85b-216d-49c3-b8e9-dd92874344bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.183677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-2ad2f85b-216d-49c3-b8e9-dd92874344bb None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:10.186671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2ad2f85b-216d-49c3-b8e9-dd92874344bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:10.250867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 302/624] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:43:10.252746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a43474-af90-43d8-83b6-c3d0199c7958 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.272708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.275178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.303587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 323/625] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:10.303587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f85b-216d-49c3-b8e9-dd92874344bb None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.392647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a43474-af90-43d8-83b6-c3d0199c7958 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.414982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f85b-216d-49c3-b8e9-dd92874344bb None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.433321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6094-0edf-4aa2-8a75-8574375aac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.434411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6094-0edf-4aa2-8a75-8574375aac15 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.435417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6094-0edf-4aa2-8a75-8574375aac15 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.435991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6094-0edf-4aa2-8a75-8574375aac15 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.437115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6094-0edf-4aa2-8a75-8574375aac15 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:10.437694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6094-0edf-4aa2-8a75-8574375aac15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.439471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6094-0edf-4aa2-8a75-8574375aac15 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.465615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 303/626] 10.222.0.93 () {56 vars in 1135 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:10.465615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6094-0edf-4aa2-8a75-8574375aac15 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.470281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162690-390a-4af1-8266-946cde7fd99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.471913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162690-390a-4af1-8266-946cde7fd99f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.471913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162690-390a-4af1-8266-946cde7fd99f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.472128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162690-390a-4af1-8266-946cde7fd99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.487096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162690-390a-4af1-8266-946cde7fd99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.489328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162690-390a-4af1-8266-946cde7fd99f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-cd162690-390a-4af1-8266-946cde7fd99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:10.518228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:10.519235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:10.520206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:10.520206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:10.520206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:10.520206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:10.525371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 324/627] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:10.526509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162690-390a-4af1-8266-946cde7fd99f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.568452 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.569347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.598042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6094-0edf-4aa2-8a75-8574375aac15 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.636613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9bcee-5a47-4d7f-9628-76ea1bb327c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.637854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9bcee-5a47-4d7f-9628-76ea1bb327c5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.638390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9bcee-5a47-4d7f-9628-76ea1bb327c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.638877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9bcee-5a47-4d7f-9628-76ea1bb327c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.657028 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9bcee-5a47-4d7f-9628-76ea1bb327c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:10.666263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162690-390a-4af1-8266-946cde7fd99f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-1cb9bcee-5a47-4d7f-9628-76ea1bb327c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:10.667124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:10.668303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:10.669837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:10.673415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 304/628] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:10.675320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9bcee-5a47-4d7f-9628-76ea1bb327c5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.722074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba669e3c-82c6-415f-82be-55eaf1d0c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.723597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba669e3c-82c6-415f-82be-55eaf1d0c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.724215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba669e3c-82c6-415f-82be-55eaf1d0c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.724811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba669e3c-82c6-415f-82be-55eaf1d0c6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.739384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba669e3c-82c6-415f-82be-55eaf1d0c6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.741826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba669e3c-82c6-415f-82be-55eaf1d0c6c3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-ba669e3c-82c6-415f-82be-55eaf1d0c6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:10.764813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:10.765778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:10.766687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:10.766687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:10.766687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:10.766687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:10.774648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 325/629] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:10.776203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba669e3c-82c6-415f-82be-55eaf1d0c6c3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.823363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9bcee-5a47-4d7f-9628-76ea1bb327c5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.876321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcebeb0-dcac-4c30-9fea-480d292b6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.876999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcebeb0-dcac-4c30-9fea-480d292b6c88 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.877292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcebeb0-dcac-4c30-9fea-480d292b6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.877732 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcebeb0-dcac-4c30-9fea-480d292b6c88 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.878502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcebeb0-dcac-4c30-9fea-480d292b6c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:10.878805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcebeb0-dcac-4c30-9fea-480d292b6c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.880990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcebeb0-dcac-4c30-9fea-480d292b6c88 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.882738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.903328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 305/630] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:10.905001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcebeb0-dcac-4c30-9fea-480d292b6c88 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.919913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.931160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba669e3c-82c6-415f-82be-55eaf1d0c6c3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.970960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57518d5b-2729-47db-9894-aca08315c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.972026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57518d5b-2729-47db-9894-aca08315c805 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.972548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57518d5b-2729-47db-9894-aca08315c805 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.973032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57518d5b-2729-47db-9894-aca08315c805 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.974062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57518d5b-2729-47db-9894-aca08315c805 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:10.974612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57518d5b-2729-47db-9894-aca08315c805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.976288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57518d5b-2729-47db-9894-aca08315c805 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.988071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 326/631] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:10.989449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57518d5b-2729-47db-9894-aca08315c805 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.061015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcebeb0-dcac-4c30-9fea-480d292b6c88 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.101156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4490e-5465-4a00-990e-9edd0f50ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.101825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4490e-5465-4a00-990e-9edd0f50ee2f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.102100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4490e-5465-4a00-990e-9edd0f50ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.102407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4490e-5465-4a00-990e-9edd0f50ee2f None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.103110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4490e-5465-4a00-990e-9edd0f50ee2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:11.103405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4490e-5465-4a00-990e-9edd0f50ee2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.104938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4490e-5465-4a00-990e-9edd0f50ee2f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.114312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57518d5b-2729-47db-9894-aca08315c805 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.120367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 306/632] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:11.121046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4490e-5465-4a00-990e-9edd0f50ee2f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.154412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40aea5c-8943-4efe-aee0-8f999bbecd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.155341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40aea5c-8943-4efe-aee0-8f999bbecd9d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.155755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40aea5c-8943-4efe-aee0-8f999bbecd9d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.156268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40aea5c-8943-4efe-aee0-8f999bbecd9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.163762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40aea5c-8943-4efe-aee0-8f999bbecd9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.165628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40aea5c-8943-4efe-aee0-8f999bbecd9d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-f40aea5c-8943-4efe-aee0-8f999bbecd9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:11.181209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:11.183029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 327/633] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2352-30b5-49c1-90b4-e382863c8ee6 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.185187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2352-30b5-49c1-90b4-e382863c8ee6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.186153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2352-30b5-49c1-90b4-e382863c8ee6 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.191625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 328/634] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:11.191625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43c053-632a-4957-9ae5-411b583ca76b None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.191625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43c053-632a-4957-9ae5-411b583ca76b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.191625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43c053-632a-4957-9ae5-411b583ca76b None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.191625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 329/635] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:11.191625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43c053-632a-4957-9ae5-411b583ca76b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.202606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:11.206054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:11.267104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4490e-5465-4a00-990e-9edd0f50ee2f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.303272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19c66-ae34-4272-befa-d31b87b62e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.304112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19c66-ae34-4272-befa-d31b87b62e54 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.304390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19c66-ae34-4272-befa-d31b87b62e54 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.304662 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19c66-ae34-4272-befa-d31b87b62e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.308866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43c053-632a-4957-9ae5-411b583ca76b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.316828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19c66-ae34-4272-befa-d31b87b62e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.318279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19c66-ae34-4272-befa-d31b87b62e54 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-d4c19c66-ae34-4272-befa-d31b87b62e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:11.336109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:11.337180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:11.338095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:11.338095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:11.338095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:11.338095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:11.338095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 307/636] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:11.338095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19c66-ae34-4272-befa-d31b87b62e54 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.349581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a60cb-0c2a-4f66-9266-ff8a8470090d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.350369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a60cb-0c2a-4f66-9266-ff8a8470090d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.350647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a60cb-0c2a-4f66-9266-ff8a8470090d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.350917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a60cb-0c2a-4f66-9266-ff8a8470090d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.358309 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a60cb-0c2a-4f66-9266-ff8a8470090d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.359785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a60cb-0c2a-4f66-9266-ff8a8470090d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-1b8a60cb-0c2a-4f66-9266-ff8a8470090d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:11.374220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:11.375217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:11.376482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:11.376482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:11.376482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:11.376482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:11.376482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:11.376482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:11.376482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:11.376482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:11.376482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 330/637] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:11.377268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50cc2f-ac5d-4bae-9504-4d6a0466fc10 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.377424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50cc2f-ac5d-4bae-9504-4d6a0466fc10 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.377699 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50cc2f-ac5d-4bae-9504-4d6a0466fc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.395383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5c50cc2f-ac5d-4bae-9504-4d6a0466fc10 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:11.396614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5c50cc2f-ac5d-4bae-9504-4d6a0466fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:11.442106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19c66-ae34-4272-befa-d31b87b62e54 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.449422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:11.458995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:11.464830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 331/638] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:11.466572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ee35-f2f5-4329-a24e-1b2da5492709 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.466852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ee35-f2f5-4329-a24e-1b2da5492709 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.467122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ee35-f2f5-4329-a24e-1b2da5492709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.479357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc253-0fd9-4070-8fff-9abbda050cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.480132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc253-0fd9-4070-8fff-9abbda050cf9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.480417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc253-0fd9-4070-8fff-9abbda050cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.480691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc253-0fd9-4070-8fff-9abbda050cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.482003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bc253-0fd9-4070-8fff-9abbda050cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:11.482310 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bc253-0fd9-4070-8fff-9abbda050cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.483781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bc253-0fd9-4070-8fff-9abbda050cf9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.486065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-aa17ee35-f2f5-4329-a24e-1b2da5492709 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:11.487909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-aa17ee35-f2f5-4329-a24e-1b2da5492709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:11.497244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 308/639] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:11.498778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc253-0fd9-4070-8fff-9abbda050cf9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.568510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 332/640] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:11.569279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ee35-f2f5-4329-a24e-1b2da5492709 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.623983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc253-0fd9-4070-8fff-9abbda050cf9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.675445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370464-2567-4e02-a278-3912b83732f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.676581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370464-2567-4e02-a278-3912b83732f0 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.676968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370464-2567-4e02-a278-3912b83732f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.677253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370464-2567-4e02-a278-3912b83732f0 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.678014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca370464-2567-4e02-a278-3912b83732f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:11.678327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca370464-2567-4e02-a278-3912b83732f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.679788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca370464-2567-4e02-a278-3912b83732f0 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.694424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 309/641] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:11.695297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370464-2567-4e02-a278-3912b83732f0 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.702531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ee35-f2f5-4329-a24e-1b2da5492709 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.725399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:11.732409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:11.740141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89702fcf-b650-4ed7-841e-c648cd321d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.740799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702fcf-b650-4ed7-841e-c648cd321d2e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.741078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702fcf-b650-4ed7-841e-c648cd321d2e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.741352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702fcf-b650-4ed7-841e-c648cd321d2e None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.742132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89702fcf-b650-4ed7-841e-c648cd321d2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:11.742435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89702fcf-b650-4ed7-841e-c648cd321d2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.743911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89702fcf-b650-4ed7-841e-c648cd321d2e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.756112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 333/642] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:11.757224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89702fcf-b650-4ed7-841e-c648cd321d2e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.805228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370464-2567-4e02-a278-3912b83732f0 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.838886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13431885-13d0-4a1f-b528-1211f40654cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.839572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13431885-13d0-4a1f-b528-1211f40654cd None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.839874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13431885-13d0-4a1f-b528-1211f40654cd None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.840144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13431885-13d0-4a1f-b528-1211f40654cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.850825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13431885-13d0-4a1f-b528-1211f40654cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:11.858793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89702fcf-b650-4ed7-841e-c648cd321d2e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-13431885-13d0-4a1f-b528-1211f40654cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:11.859054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:11.860144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 310/643] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:11.861287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13431885-13d0-4a1f-b528-1211f40654cd None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.895090 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ceaa2-12ea-4dde-af0f-e1e8d63e1b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:11.895719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ceaa2-12ea-4dde-af0f-e1e8d63e1b82 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:11.895999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ceaa2-12ea-4dde-af0f-e1e8d63e1b82 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:11.896268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ceaa2-12ea-4dde-af0f-e1e8d63e1b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.897087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ceaa2-12ea-4dde-af0f-e1e8d63e1b82 None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=8dd8a5a74a2947e385ca0cb7f3ee6428) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:11.897392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ceaa2-12ea-4dde-af0f-e1e8d63e1b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.898825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ceaa2-12ea-4dde-af0f-e1e8d63e1b82 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.906158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 334/644] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/role_assignments?user.id=8dd8a5a74a2947e385ca0cb7f3ee6428&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:11.906979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ceaa2-12ea-4dde-af0f-e1e8d63e1b82 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:11.966966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:11.974290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:11.990938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13431885-13d0-4a1f-b528-1211f40654cd None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.036460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8768b97-7b7c-4c3f-a2ec-f69be9cde01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.037330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8768b97-7b7c-4c3f-a2ec-f69be9cde01c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.037605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8768b97-7b7c-4c3f-a2ec-f69be9cde01c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.037875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8768b97-7b7c-4c3f-a2ec-f69be9cde01c None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.044017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ceaa2-12ea-4dde-af0f-e1e8d63e1b82 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.051790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8768b97-7b7c-4c3f-a2ec-f69be9cde01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-b8768b97-7b7c-4c3f-a2ec-f69be9cde01c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:12.060350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:12.061853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 311/645] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:12.062949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8768b97-7b7c-4c3f-a2ec-f69be9cde01c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.105038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835a466-bb75-4f0a-908a-453a57d9428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.105762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835a466-bb75-4f0a-908a-453a57d9428c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.106046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835a466-bb75-4f0a-908a-453a57d9428c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.106323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835a466-bb75-4f0a-908a-453a57d9428c None admin] PATH_INFO: `/v3/users/glance` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.115651 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835a466-bb75-4f0a-908a-453a57d9428c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.116734 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835a466-bb75-4f0a-908a-453a57d9428c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-0835a466-bb75-4f0a-908a-453a57d9428c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:12.132647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:12.134298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 335/646] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:12.135809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835a466-bb75-4f0a-908a-453a57d9428c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.206084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8768b97-7b7c-4c3f-a2ec-f69be9cde01c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.244462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40775-d28b-4949-a0d0-3f47e60618be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.245378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40775-d28b-4949-a0d0-3f47e60618be None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.245876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40775-d28b-4949-a0d0-3f47e60618be None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.245988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40775-d28b-4949-a0d0-3f47e60618be None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/45cfc967b8634e60b3ddfe4168a748b4/roles/a13a3c6af2864ff1848ccbb2da56273e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.258298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835a466-bb75-4f0a-908a-453a57d9428c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.261831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd40775-d28b-4949-a0d0-3f47e60618be None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=45cfc967b8634e60b3ddfe4168a748b4, role_id=a13a3c6af2864ff1848ccbb2da56273e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.263955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd40775-d28b-4949-a0d0-3f47e60618be None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.267686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:12.274963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:12.296247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a82aa-cc81-4efc-8cd8-0faf5e1bbbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.296890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a82aa-cc81-4efc-8cd8-0faf5e1bbbc4 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.297168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a82aa-cc81-4efc-8cd8-0faf5e1bbbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.297439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a82aa-cc81-4efc-8cd8-0faf5e1bbbc4 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.298175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a82aa-cc81-4efc-8cd8-0faf5e1bbbc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:12.298475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a82aa-cc81-4efc-8cd8-0faf5e1bbbc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.299923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a82aa-cc81-4efc-8cd8-0faf5e1bbbc4 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.308589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 336/647] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:12.309396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a82aa-cc81-4efc-8cd8-0faf5e1bbbc4 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.354170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 312/648] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:43:12 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/45cfc967b8634e60b3ddfe4168a748b4/roles/a13a3c6af2864ff1848ccbb2da56273e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:12.357042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40775-d28b-4949-a0d0-3f47e60618be None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.444287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a82aa-cc81-4efc-8cd8-0faf5e1bbbc4 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.485137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481b7eb-3dc7-4635-b591-ff389c38edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.485823 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b7eb-3dc7-4635-b591-ff389c38edca None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.486108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b7eb-3dc7-4635-b591-ff389c38edca None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.486656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b7eb-3dc7-4635-b591-ff389c38edca None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.487195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481b7eb-3dc7-4635-b591-ff389c38edca None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:12.487420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481b7eb-3dc7-4635-b591-ff389c38edca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.488990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481b7eb-3dc7-4635-b591-ff389c38edca None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.491888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40775-d28b-4949-a0d0-3f47e60618be None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.505115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 337/649] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:12.505115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481b7eb-3dc7-4635-b591-ff389c38edca None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.537021 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988b25e-17ef-4459-aecc-a7a509c772d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.538136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988b25e-17ef-4459-aecc-a7a509c772d9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.538737 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988b25e-17ef-4459-aecc-a7a509c772d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.539201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988b25e-17ef-4459-aecc-a7a509c772d9 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.540288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988b25e-17ef-4459-aecc-a7a509c772d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:12.540819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988b25e-17ef-4459-aecc-a7a509c772d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.542827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988b25e-17ef-4459-aecc-a7a509c772d9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.546498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:12.565013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 313/650] 10.222.0.93 () {56 vars in 1137 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:12.566330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988b25e-17ef-4459-aecc-a7a509c772d9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.627758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481b7eb-3dc7-4635-b591-ff389c38edca None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.634862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:12.671022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a19eff-646a-414f-99a4-cd6a2a9ec8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.672463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a19eff-646a-414f-99a4-cd6a2a9ec8f0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.672936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a19eff-646a-414f-99a4-cd6a2a9ec8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.673557 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a19eff-646a-414f-99a4-cd6a2a9ec8f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.684335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988b25e-17ef-4459-aecc-a7a509c772d9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.692726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a19eff-646a-414f-99a4-cd6a2a9ec8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.695481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a19eff-646a-414f-99a4-cd6a2a9ec8f0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-01a19eff-646a-414f-99a4-cd6a2a9ec8f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:12.720288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:12.721286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:12.722214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:12.722214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:12.722214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:12.722214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:12.724355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 338/651] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:12.725322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a19eff-646a-414f-99a4-cd6a2a9ec8f0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.728575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65428edd-cde6-4146-b36b-f9688fe6fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.729650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65428edd-cde6-4146-b36b-f9688fe6fc83 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.730001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65428edd-cde6-4146-b36b-f9688fe6fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.730345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65428edd-cde6-4146-b36b-f9688fe6fc83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.743660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65428edd-cde6-4146-b36b-f9688fe6fc83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.745376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65428edd-cde6-4146-b36b-f9688fe6fc83 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-65428edd-cde6-4146-b36b-f9688fe6fc83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:12.765201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:12.766212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:12.767477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:12.767477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:12.767477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:12.767477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:12.767477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 314/652] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:12.767867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65428edd-cde6-4146-b36b-f9688fe6fc83 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:12.841797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:12.855310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a19eff-646a-414f-99a4-cd6a2a9ec8f0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.893322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8bf12-69b9-4949-82f8-38728d345de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.894168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8bf12-69b9-4949-82f8-38728d345de5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.894554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8bf12-69b9-4949-82f8-38728d345de5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.894959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8bf12-69b9-4949-82f8-38728d345de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.910514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65428edd-cde6-4146-b36b-f9688fe6fc83 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:12.921013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:12.958993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ba9e-724e-40b7-9e5c-eed198977eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:12.959688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ba9e-724e-40b7-9e5c-eed198977eb7 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:12.959997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ba9e-724e-40b7-9e5c-eed198977eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:12.960251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ba9e-724e-40b7-9e5c-eed198977eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:12.960975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2ba9e-724e-40b7-9e5c-eed198977eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:12.961278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2ba9e-724e-40b7-9e5c-eed198977eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.962778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2ba9e-724e-40b7-9e5c-eed198977eb7 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.974297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8bf12-69b9-4949-82f8-38728d345de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:12.976241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8bf12-69b9-4949-82f8-38728d345de5 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:12.980656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 315/653] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:12.982092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ba9e-724e-40b7-9e5c-eed198977eb7 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.080091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:13.099028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 339/654] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:43:13.100433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8bf12-69b9-4949-82f8-38728d345de5 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.114454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ba9e-724e-40b7-9e5c-eed198977eb7 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.159631 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab74ec-3893-4197-9e99-fececc5eedbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.160209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab74ec-3893-4197-9e99-fececc5eedbb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.160564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab74ec-3893-4197-9e99-fececc5eedbb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.161466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab74ec-3893-4197-9e99-fececc5eedbb None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.163899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab74ec-3893-4197-9e99-fececc5eedbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:13.164221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab74ec-3893-4197-9e99-fececc5eedbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.167269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab74ec-3893-4197-9e99-fececc5eedbb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.197061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 316/655] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:13.197061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab74ec-3893-4197-9e99-fececc5eedbb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.226653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8bf12-69b9-4949-82f8-38728d345de5 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.236184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:13.272573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ea4b9-427c-4a63-ae1a-4db27cfad5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.273929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ea4b9-427c-4a63-ae1a-4db27cfad5f3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.274343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ea4b9-427c-4a63-ae1a-4db27cfad5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.274632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ea4b9-427c-4a63-ae1a-4db27cfad5f3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.287879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ea4b9-427c-4a63-ae1a-4db27cfad5f3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.290018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ea4b9-427c-4a63-ae1a-4db27cfad5f3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-8b0ea4b9-427c-4a63-ae1a-4db27cfad5f3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:13.312125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:13.313256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:43:13.314233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:13.318905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 340/656] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:13.320007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ea4b9-427c-4a63-ae1a-4db27cfad5f3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.333697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab74ec-3893-4197-9e99-fececc5eedbb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.379634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb03ee-beda-450d-9dc4-b9717848ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.380946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb03ee-beda-450d-9dc4-b9717848ee85 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.381413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb03ee-beda-450d-9dc4-b9717848ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.382214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb03ee-beda-450d-9dc4-b9717848ee85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.384304 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:13.396820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb03ee-beda-450d-9dc4-b9717848ee85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.398290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb03ee-beda-450d-9dc4-b9717848ee85 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-99bb03ee-beda-450d-9dc4-b9717848ee85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:13.423102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:13.424063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:13.424959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:13.424959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:13.424959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:13.424959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:13.425182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 317/657] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:13.426369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb03ee-beda-450d-9dc4-b9717848ee85 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.454584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ea4b9-427c-4a63-ae1a-4db27cfad5f3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.511343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400d5b4-53c6-4ff0-8ef6-38f74f4f9656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.512615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400d5b4-53c6-4ff0-8ef6-38f74f4f9656 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.512921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400d5b4-53c6-4ff0-8ef6-38f74f4f9656 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.513194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400d5b4-53c6-4ff0-8ef6-38f74f4f9656 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.514148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:13.523968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400d5b4-53c6-4ff0-8ef6-38f74f4f9656 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.527241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400d5b4-53c6-4ff0-8ef6-38f74f4f9656 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.537646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb03ee-beda-450d-9dc4-b9717848ee85 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-e400d5b4-53c6-4ff0-8ef6-38f74f4f9656 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:13.552926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:13.554022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:43:13.554976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:13.557731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 341/658] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:13.559764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400d5b4-53c6-4ff0-8ef6-38f74f4f9656 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.577594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799689ce-edae-4879-a44a-7e6ce180de06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.578290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799689ce-edae-4879-a44a-7e6ce180de06 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.578569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799689ce-edae-4879-a44a-7e6ce180de06 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.579150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799689ce-edae-4879-a44a-7e6ce180de06 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.579736 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799689ce-edae-4879-a44a-7e6ce180de06 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:13.580082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799689ce-edae-4879-a44a-7e6ce180de06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.581554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799689ce-edae-4879-a44a-7e6ce180de06 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.605294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 318/659] 10.222.0.93 () {56 vars in 1139 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:13.605294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799689ce-edae-4879-a44a-7e6ce180de06 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.687967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400d5b4-53c6-4ff0-8ef6-38f74f4f9656 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.701063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:13.711663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799689ce-edae-4879-a44a-7e6ce180de06 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.730751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bda60-f530-4c9a-8f03-7f1cdbce19c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.731978 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bda60-f530-4c9a-8f03-7f1cdbce19c1 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.732507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bda60-f530-4c9a-8f03-7f1cdbce19c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.733028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bda60-f530-4c9a-8f03-7f1cdbce19c1 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.734433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bda60-f530-4c9a-8f03-7f1cdbce19c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:13.735164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bda60-f530-4c9a-8f03-7f1cdbce19c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.737276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bda60-f530-4c9a-8f03-7f1cdbce19c1 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.752632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32abe5e-0b2b-4748-ab82-0d423de1ce7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.752848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 342/660] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:13.753398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32abe5e-0b2b-4748-ab82-0d423de1ce7a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.753685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32abe5e-0b2b-4748-ab82-0d423de1ce7a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.753962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32abe5e-0b2b-4748-ab82-0d423de1ce7a None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.754699 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bda60-f530-4c9a-8f03-7f1cdbce19c1 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.754808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32abe5e-0b2b-4748-ab82-0d423de1ce7a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:13.755123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32abe5e-0b2b-4748-ab82-0d423de1ce7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.756641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32abe5e-0b2b-4748-ab82-0d423de1ce7a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.760744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:13.779110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 319/661] 10.222.0.93 () {56 vars in 1137 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:13.780043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32abe5e-0b2b-4748-ab82-0d423de1ce7a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.874684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bda60-f530-4c9a-8f03-7f1cdbce19c1 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.890474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32abe5e-0b2b-4748-ab82-0d423de1ce7a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:13.914314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cae8ce-ce54-43c3-a51d-d76b27ce176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.915370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae8ce-ce54-43c3-a51d-d76b27ce176b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.915900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae8ce-ce54-43c3-a51d-d76b27ce176b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.916460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae8ce-ce54-43c3-a51d-d76b27ce176b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.928375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c727e-908c-4fda-8ddb-9c40e7022760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:13.929450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c727e-908c-4fda-8ddb-9c40e7022760 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:13.929668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c727e-908c-4fda-8ddb-9c40e7022760 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:13.929796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c727e-908c-4fda-8ddb-9c40e7022760 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:13.937928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c727e-908c-4fda-8ddb-9c40e7022760 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:13.939641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c727e-908c-4fda-8ddb-9c40e7022760 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-621c727e-908c-4fda-8ddb-9c40e7022760 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:13.955044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:13.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:13.957087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:13.957087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:13.957087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:13.957087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:13.957087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:13.957087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:13.957087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:13.957087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:13.957087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 320/662] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:13.957752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c727e-908c-4fda-8ddb-9c40e7022760 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:13.962375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.002571 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cae8ce-ce54-43c3-a51d-d76b27ce176b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.004164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cae8ce-ce54-43c3-a51d-d76b27ce176b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.019931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.068665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c727e-908c-4fda-8ddb-9c40e7022760 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.107368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab3dc-cc25-44ec-9af4-1322c4284abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.108359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab3dc-cc25-44ec-9af4-1322c4284abd None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.108795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab3dc-cc25-44ec-9af4-1322c4284abd None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.109433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab3dc-cc25-44ec-9af4-1322c4284abd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.125543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 343/663] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:43:14.126482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cae8ce-ce54-43c3-a51d-d76b27ce176b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.193839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ab3dc-cc25-44ec-9af4-1322c4284abd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.196195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ab3dc-cc25-44ec-9af4-1322c4284abd None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.216809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.261582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.265290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cae8ce-ce54-43c3-a51d-d76b27ce176b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.317769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448e277-e57a-4682-9849-5f19dd0ad2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.319446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448e277-e57a-4682-9849-5f19dd0ad2b3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.319998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448e277-e57a-4682-9849-5f19dd0ad2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.320747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448e277-e57a-4682-9849-5f19dd0ad2b3 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.322058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448e277-e57a-4682-9849-5f19dd0ad2b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:14.322983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448e277-e57a-4682-9849-5f19dd0ad2b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.325165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448e277-e57a-4682-9849-5f19dd0ad2b3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.331479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 321/664] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:43:14.332476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab3dc-cc25-44ec-9af4-1322c4284abd None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.342757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 344/665] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:14.344694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448e277-e57a-4682-9849-5f19dd0ad2b3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.456312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab3dc-cc25-44ec-9af4-1322c4284abd None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.466551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448e277-e57a-4682-9849-5f19dd0ad2b3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.500551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74af1-ed00-4d29-ad78-95c2b09d72fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.501350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74af1-ed00-4d29-ad78-95c2b09d72fe None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.501637 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74af1-ed00-4d29-ad78-95c2b09d72fe None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.501917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74af1-ed00-4d29-ad78-95c2b09d72fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.503548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.511943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fa068-5b87-4ed4-ac57-51c519695c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.512679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74af1-ed00-4d29-ad78-95c2b09d72fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.514433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fa068-5b87-4ed4-ac57-51c519695c5e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.514433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fa068-5b87-4ed4-ac57-51c519695c5e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.514433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fa068-5b87-4ed4-ac57-51c519695c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.514803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74af1-ed00-4d29-ad78-95c2b09d72fe None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.524822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fa068-5b87-4ed4-ac57-51c519695c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.526581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fa068-5b87-4ed4-ac57-51c519695c5e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-7ca74af1-ed00-4d29-ad78-95c2b09d72fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:14.533459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:14.534752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:14.536742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:14.536742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:14.536742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:14.536742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:14.536742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 322/666] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:14.536742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74af1-ed00-4d29-ad78-95c2b09d72fe None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.545206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-ac4fa068-5b87-4ed4-ac57-51c519695c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:14.550017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:14.550927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:14.552612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:14.552612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:14.552612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:14.552612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:14.552612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 345/667] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:14.553055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaca23-4735-4fb0-b611-a4ccce43d12e None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.553055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaca23-4735-4fb0-b611-a4ccce43d12e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.553437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaca23-4735-4fb0-b611-a4ccce43d12e None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.559049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 346/668] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:14.559049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaca23-4735-4fb0-b611-a4ccce43d12e None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.658875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74af1-ed00-4d29-ad78-95c2b09d72fe None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.670257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaca23-4735-4fb0-b611-a4ccce43d12e None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.702234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a40eb2-0b3d-4d31-b3ad-ba82d5e9759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.703029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40eb2-0b3d-4d31-b3ad-ba82d5e9759d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.703380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40eb2-0b3d-4d31-b3ad-ba82d5e9759d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.703795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40eb2-0b3d-4d31-b3ad-ba82d5e9759d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.704833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a40eb2-0b3d-4d31-b3ad-ba82d5e9759d None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=4145a3bf87a94f4e9d39e16dc483595b) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:14.705219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a40eb2-0b3d-4d31-b3ad-ba82d5e9759d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.706781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a40eb2-0b3d-4d31-b3ad-ba82d5e9759d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.712322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5dd1a6-44ba-4cce-adf8-22a2de9928d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.713072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dd1a6-44ba-4cce-adf8-22a2de9928d1 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.713527 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 323/669] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/role_assignments?user.id=4145a3bf87a94f4e9d39e16dc483595b&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:14.714162 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a40eb2-0b3d-4d31-b3ad-ba82d5e9759d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.723721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dd1a6-44ba-4cce-adf8-22a2de9928d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.724176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dd1a6-44ba-4cce-adf8-22a2de9928d1 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.724989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dd1a6-44ba-4cce-adf8-22a2de9928d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:14.725305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dd1a6-44ba-4cce-adf8-22a2de9928d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.726740 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dd1a6-44ba-4cce-adf8-22a2de9928d1 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.741709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 347/670] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:14.743338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b2ea7-03ae-41d0-a789-241f607cd496 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.743650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b2ea7-03ae-41d0-a789-241f607cd496 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.743928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b2ea7-03ae-41d0-a789-241f607cd496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.764943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-180b2ea7-03ae-41d0-a789-241f607cd496 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:14.766053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-180b2ea7-03ae-41d0-a789-241f607cd496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:14.809386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.812286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:14.846761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a40eb2-0b3d-4d31-b3ad-ba82d5e9759d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.849280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 348/671] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:14.850155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b2ea7-03ae-41d0-a789-241f607cd496 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.901520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d2c50-52ba-43c1-b8a2-c63800df64cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.902196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d2c50-52ba-43c1-b8a2-c63800df64cd None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.902477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d2c50-52ba-43c1-b8a2-c63800df64cd None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.902755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d2c50-52ba-43c1-b8a2-c63800df64cd None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.903510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d2c50-52ba-43c1-b8a2-c63800df64cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:14.903852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d2c50-52ba-43c1-b8a2-c63800df64cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.905263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d2c50-52ba-43c1-b8a2-c63800df64cd None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.919709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 324/672] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:14.921123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e77e9c-5592-460d-b81f-75987a6bfd8c None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.921418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e77e9c-5592-460d-b81f-75987a6bfd8c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.921688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e77e9c-5592-460d-b81f-75987a6bfd8c None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.930833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 325/673] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:14.930833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e77e9c-5592-460d-b81f-75987a6bfd8c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.999985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b2ea7-03ae-41d0-a789-241f607cd496 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.040329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e77e9c-5592-460d-b81f-75987a6bfd8c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.040529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d03aa-0a7f-4d8a-a361-e90ffd5b97bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.041229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d03aa-0a7f-4d8a-a361-e90ffd5b97bf None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.041513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d03aa-0a7f-4d8a-a361-e90ffd5b97bf None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.041785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d03aa-0a7f-4d8a-a361-e90ffd5b97bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.049697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d03aa-0a7f-4d8a-a361-e90ffd5b97bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.051154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d03aa-0a7f-4d8a-a361-e90ffd5b97bf None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-940d03aa-0a7f-4d8a-a361-e90ffd5b97bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:15.066143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:15.067112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:15.068096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:15.068096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:15.068096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:15.068096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:15.068096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:15.068096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:15.068096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:15.068096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:15.068096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 349/674] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:15.068598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d03aa-0a7f-4d8a-a361-e90ffd5b97bf None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:15.082579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d12af8-8e0b-40d3-bd0a-78df828c2da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.083364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d12af8-8e0b-40d3-bd0a-78df828c2da4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.083673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d12af8-8e0b-40d3-bd0a-78df828c2da4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.083947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d12af8-8e0b-40d3-bd0a-78df828c2da4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.094884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d12af8-8e0b-40d3-bd0a-78df828c2da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-45d12af8-8e0b-40d3-bd0a-78df828c2da4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:15.102700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:15.103757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:15.104656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 326/675] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:15.106037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7d193-c0dc-456f-8a57-26e32597e79a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.106037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7d193-c0dc-456f-8a57-26e32597e79a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.106197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7d193-c0dc-456f-8a57-26e32597e79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.114165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:15.125651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-68b7d193-c0dc-456f-8a57-26e32597e79a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:15.126868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-68b7d193-c0dc-456f-8a57-26e32597e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:15.193697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d03aa-0a7f-4d8a-a361-e90ffd5b97bf None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.217776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 327/676] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:15.219390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7d193-c0dc-456f-8a57-26e32597e79a None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.233882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd6c3e-61e1-4867-a8c4-3f5d40be5457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.234998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd6c3e-61e1-4867-a8c4-3f5d40be5457 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.235510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd6c3e-61e1-4867-a8c4-3f5d40be5457 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.236058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd6c3e-61e1-4867-a8c4-3f5d40be5457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.243754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd6c3e-61e1-4867-a8c4-3f5d40be5457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.246453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd6c3e-61e1-4867-a8c4-3f5d40be5457 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-d7fd6c3e-61e1-4867-a8c4-3f5d40be5457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:15.263452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:15.264468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:15.265388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:15.265388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:15.265388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:15.265388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:15.265388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:15.265388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:15.265388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:15.265388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:15.265388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 350/677] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:15.266347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd6c3e-61e1-4867-a8c4-3f5d40be5457 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.352485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7d193-c0dc-456f-8a57-26e32597e79a None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.376382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:15.378489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:15.388894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd6c3e-61e1-4867-a8c4-3f5d40be5457 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.391668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d26ea-62d4-4f62-958a-8bb85cfa654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.392330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d26ea-62d4-4f62-958a-8bb85cfa654a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.392900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d26ea-62d4-4f62-958a-8bb85cfa654a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.392900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d26ea-62d4-4f62-958a-8bb85cfa654a None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.393707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d26ea-62d4-4f62-958a-8bb85cfa654a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:15.394016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d26ea-62d4-4f62-958a-8bb85cfa654a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.395548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d26ea-62d4-4f62-958a-8bb85cfa654a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.408119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 328/678] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:15.409318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d26ea-62d4-4f62-958a-8bb85cfa654a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.433868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a416757-39e3-43f2-9120-6850898c3ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.435341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a416757-39e3-43f2-9120-6850898c3ea7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.435698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a416757-39e3-43f2-9120-6850898c3ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.435997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a416757-39e3-43f2-9120-6850898c3ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.437107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a416757-39e3-43f2-9120-6850898c3ea7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:15.437498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a416757-39e3-43f2-9120-6850898c3ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.439667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a416757-39e3-43f2-9120-6850898c3ea7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.448760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 351/679] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:15.449867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a416757-39e3-43f2-9120-6850898c3ea7 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.534569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d26ea-62d4-4f62-958a-8bb85cfa654a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.574494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47082f96-38f7-41b7-a119-a6a324c2b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.575321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47082f96-38f7-41b7-a119-a6a324c2b562 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.575630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47082f96-38f7-41b7-a119-a6a324c2b562 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.575910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47082f96-38f7-41b7-a119-a6a324c2b562 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.577036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a416757-39e3-43f2-9120-6850898c3ea7 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.600235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47082f96-38f7-41b7-a119-a6a324c2b562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-47082f96-38f7-41b7-a119-a6a324c2b562 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:15.609499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:15.610725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:15.611763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 329/680] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:15.612692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47082f96-38f7-41b7-a119-a6a324c2b562 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.637443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0529b84-2997-4aaf-aab6-33422f0ef815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.638257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529b84-2997-4aaf-aab6-33422f0ef815 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.638702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529b84-2997-4aaf-aab6-33422f0ef815 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.639031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529b84-2997-4aaf-aab6-33422f0ef815 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.640018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0529b84-2997-4aaf-aab6-33422f0ef815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:15.640328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0529b84-2997-4aaf-aab6-33422f0ef815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.642536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0529b84-2997-4aaf-aab6-33422f0ef815 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.659190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 352/681] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:15.660447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0529b84-2997-4aaf-aab6-33422f0ef815 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.671394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:15.686860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:15.743314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47082f96-38f7-41b7-a119-a6a324c2b562 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.787963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c525b53-01f8-4baa-9f36-5f459b13c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.788518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525b53-01f8-4baa-9f36-5f459b13c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.788794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525b53-01f8-4baa-9f36-5f459b13c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.789065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525b53-01f8-4baa-9f36-5f459b13c6d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.789448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0529b84-2997-4aaf-aab6-33422f0ef815 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.789898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c525b53-01f8-4baa-9f36-5f459b13c6d6 None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=8fee665c10364944a8162548f91a431e) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:15.790202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c525b53-01f8-4baa-9f36-5f459b13c6d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.792787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c525b53-01f8-4baa-9f36-5f459b13c6d6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.809008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 330/682] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/role_assignments?user.id=8fee665c10364944a8162548f91a431e&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:15.809008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c525b53-01f8-4baa-9f36-5f459b13c6d6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.830512 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367326a-f2a8-4024-829a-907388d1c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.831434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367326a-f2a8-4024-829a-907388d1c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.831815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367326a-f2a8-4024-829a-907388d1c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.832150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367326a-f2a8-4024-829a-907388d1c0a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.845563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367326a-f2a8-4024-829a-907388d1c0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.847140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367326a-f2a8-4024-829a-907388d1c0a3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-4367326a-f2a8-4024-829a-907388d1c0a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:15.867746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:15.868907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:15.870058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:15.870058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:15.870058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:15.870058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:15.876122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 353/683] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:15.877284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367326a-f2a8-4024-829a-907388d1c0a3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.960205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c525b53-01f8-4baa-9f36-5f459b13c6d6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.960927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:15.963988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.001159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa5bcd-d372-4758-9540-3d97f361e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.002101 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa5bcd-d372-4758-9540-3d97f361e478 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.002450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa5bcd-d372-4758-9540-3d97f361e478 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.002795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa5bcd-d372-4758-9540-3d97f361e478 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.003673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa5bcd-d372-4758-9540-3d97f361e478 None admin] RBAC: Adding query filter params (name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:16.004062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa5bcd-d372-4758-9540-3d97f361e478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.005898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa5bcd-d372-4758-9540-3d97f361e478 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.009252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367326a-f2a8-4024-829a-907388d1c0a3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.016319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 331/684] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:16.017283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa5bcd-d372-4758-9540-3d97f361e478 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.050409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdfda8-3136-495e-aa82-2e5137d259fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.051370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdfda8-3136-495e-aa82-2e5137d259fd None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.051872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdfda8-3136-495e-aa82-2e5137d259fd None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.052362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdfda8-3136-495e-aa82-2e5137d259fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.053387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdfda8-3136-495e-aa82-2e5137d259fd None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=68cb539d18194ce6a0ad60f206699d78) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:16.053908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdfda8-3136-495e-aa82-2e5137d259fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.055583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdfda8-3136-495e-aa82-2e5137d259fd None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.063112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 354/685] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/role_assignments?user.id=68cb539d18194ce6a0ad60f206699d78&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:16.064294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdfda8-3136-495e-aa82-2e5137d259fd None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.163819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa5bcd-d372-4758-9540-3d97f361e478 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.204942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdfda8-3136-495e-aa82-2e5137d259fd None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.214298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e46b-bbc9-4946-b3d3-7d27fc23821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.215120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e46b-bbc9-4946-b3d3-7d27fc23821e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.215470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e46b-bbc9-4946-b3d3-7d27fc23821e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.215904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e46b-bbc9-4946-b3d3-7d27fc23821e None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.217645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e46b-bbc9-4946-b3d3-7d27fc23821e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:16.218022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e46b-bbc9-4946-b3d3-7d27fc23821e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.219495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e46b-bbc9-4946-b3d3-7d27fc23821e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.256502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 332/686] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:16.264703 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e46b-bbc9-4946-b3d3-7d27fc23821e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.267020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.279351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f94a91-294a-4366-9a6d-32c6afdb64a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.283800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f94a91-294a-4366-9a6d-32c6afdb64a5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.283800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f94a91-294a-4366-9a6d-32c6afdb64a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.283800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f94a91-294a-4366-9a6d-32c6afdb64a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.316668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f94a91-294a-4366-9a6d-32c6afdb64a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.318097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f94a91-294a-4366-9a6d-32c6afdb64a5 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.332975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-34f94a91-294a-4366-9a6d-32c6afdb64a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:16.350636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:16.361225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:16.362908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:16.362908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:16.362908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:16.362908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:16.362908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 355/687] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:16.362908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f94a91-294a-4366-9a6d-32c6afdb64a5 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.440197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e46b-bbc9-4946-b3d3-7d27fc23821e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.485848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d4d2-e7d4-49a9-b7f7-c6bfcc881f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.486660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d4d2-e7d4-49a9-b7f7-c6bfcc881f67 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.486946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d4d2-e7d4-49a9-b7f7-c6bfcc881f67 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.487224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d4d2-e7d4-49a9-b7f7-c6bfcc881f67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.498481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14d4d2-e7d4-49a9-b7f7-c6bfcc881f67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.500286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14d4d2-e7d4-49a9-b7f7-c6bfcc881f67 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.515446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f94a91-294a-4366-9a6d-32c6afdb64a5 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-0b14d4d2-e7d4-49a9-b7f7-c6bfcc881f67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:16.520986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:16.521999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:16.522975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 333/688] 10.222.0.93 () {56 vars in 1093 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:16.528862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d4d2-e7d4-49a9-b7f7-c6bfcc881f67 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.573435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c9027-1b93-4f51-b110-d364150daa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.574498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c9027-1b93-4f51-b110-d364150daa0e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.575026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c9027-1b93-4f51-b110-d364150daa0e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.575608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c9027-1b93-4f51-b110-d364150daa0e None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.576643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c9027-1b93-4f51-b110-d364150daa0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:16.577659 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c9027-1b93-4f51-b110-d364150daa0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.579993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c9027-1b93-4f51-b110-d364150daa0e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.615273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 356/689] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:16.620530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c9027-1b93-4f51-b110-d364150daa0e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.646402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.677790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d4d2-e7d4-49a9-b7f7-c6bfcc881f67 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.712398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.756315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0d7c2-2422-4257-a99a-6d8a195489a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.757008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0d7c2-2422-4257-a99a-6d8a195489a8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.757702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0d7c2-2422-4257-a99a-6d8a195489a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.757702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0d7c2-2422-4257-a99a-6d8a195489a8 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.758416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0d7c2-2422-4257-a99a-6d8a195489a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:16.758733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0d7c2-2422-4257-a99a-6d8a195489a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.760503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0d7c2-2422-4257-a99a-6d8a195489a8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.780606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 334/690] 10.222.0.93 () {56 vars in 1133 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:16.786962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0d7c2-2422-4257-a99a-6d8a195489a8 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.790214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c9027-1b93-4f51-b110-d364150daa0e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.839469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d6fac-9ded-4a62-a913-f7939a2ed52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.839469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6fac-9ded-4a62-a913-f7939a2ed52b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.839469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6fac-9ded-4a62-a913-f7939a2ed52b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.839469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6fac-9ded-4a62-a913-f7939a2ed52b None admin] PATH_INFO: `/v3/users/swift` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.843398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d6fac-9ded-4a62-a913-f7939a2ed52b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.845032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d6fac-9ded-4a62-a913-f7939a2ed52b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-fa5d6fac-9ded-4a62-a913-f7939a2ed52b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:16.866928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:16.868022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:16.869075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:16.871353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 357/691] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:16.880671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d6fac-9ded-4a62-a913-f7939a2ed52b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.978009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0d7c2-2422-4257-a99a-6d8a195489a8 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.014697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d6fac-9ded-4a62-a913-f7939a2ed52b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.023966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.031212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be722aa8-bb39-4cf5-a25d-339a0b6f6668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.031934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be722aa8-bb39-4cf5-a25d-339a0b6f6668 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.032338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be722aa8-bb39-4cf5-a25d-339a0b6f6668 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.036508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be722aa8-bb39-4cf5-a25d-339a0b6f6668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.068026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.082642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015543a-deab-4b0d-9893-31bd75eec80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.083353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015543a-deab-4b0d-9893-31bd75eec80c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.083717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015543a-deab-4b0d-9893-31bd75eec80c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.083999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015543a-deab-4b0d-9893-31bd75eec80c None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.084913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015543a-deab-4b0d-9893-31bd75eec80c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:17.085233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015543a-deab-4b0d-9893-31bd75eec80c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.087358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015543a-deab-4b0d-9893-31bd75eec80c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.115006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 358/692] 10.222.0.93 () {56 vars in 1135 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:17.120469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015543a-deab-4b0d-9893-31bd75eec80c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.205402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be722aa8-bb39-4cf5-a25d-339a0b6f6668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.206903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be722aa8-bb39-4cf5-a25d-339a0b6f6668 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.322441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015543a-deab-4b0d-9893-31bd75eec80c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.368163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0f42d-5601-432a-909c-137f500a1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.368735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0f42d-5601-432a-909c-137f500a1582 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.369018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0f42d-5601-432a-909c-137f500a1582 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.369294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0f42d-5601-432a-909c-137f500a1582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.378764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 335/693] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:43:17.380878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984884-b907-44bb-861f-2232dc4429bd None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.381407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984884-b907-44bb-861f-2232dc4429bd None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.381879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984884-b907-44bb-861f-2232dc4429bd None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.384219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 336/694] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:17.389389 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4984884-b907-44bb-861f-2232dc4429bd None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.411125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.460383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.473166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0f42d-5601-432a-909c-137f500a1582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.475307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0f42d-5601-432a-909c-137f500a1582 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.531175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4984884-b907-44bb-861f-2232dc4429bd None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.568697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3282508-927b-4215-87a2-b1f2ff52d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.569692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3282508-927b-4215-87a2-b1f2ff52d85e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.570170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3282508-927b-4215-87a2-b1f2ff52d85e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.570536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3282508-927b-4215-87a2-b1f2ff52d85e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.583105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3282508-927b-4215-87a2-b1f2ff52d85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.584805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3282508-927b-4215-87a2-b1f2ff52d85e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.589853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 359/695] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:43:17.592486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1a7e-7e17-4983-a773-e30c046f3337 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.592943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1a7e-7e17-4983-a773-e30c046f3337 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.593343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1a7e-7e17-4983-a773-e30c046f3337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-c3282508-927b-4215-87a2-b1f2ff52d85e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:17.609971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:17.611132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:17.612065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:17.612065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:17.612065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:17.612065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:17.615538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-937a1a7e-7e17-4983-a773-e30c046f3337 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:17.616753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 337/696] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:17.617407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-937a1a7e-7e17-4983-a773-e30c046f3337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.617767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3282508-927b-4215-87a2-b1f2ff52d85e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.680400 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.699657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 360/697] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:17.704687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a1a7e-7e17-4983-a773-e30c046f3337 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.742871 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.750748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3282508-927b-4215-87a2-b1f2ff52d85e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.790040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0afc-5295-468d-98c8-98fba114ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.791407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0afc-5295-468d-98c8-98fba114ad8b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.791407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0afc-5295-468d-98c8-98fba114ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.791815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0afc-5295-468d-98c8-98fba114ad8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.805635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab0afc-5295-468d-98c8-98fba114ad8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.807068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab0afc-5295-468d-98c8-98fba114ad8b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-5dab0afc-5295-468d-98c8-98fba114ad8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:17.828807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:17.829788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:17.830712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:17.830712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:17.830712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:17.830712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:17.830712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 338/698] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:17.835912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0afc-5295-468d-98c8-98fba114ad8b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.844715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a1a7e-7e17-4983-a773-e30c046f3337 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.885421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea210ba-5b55-4982-b1e5-f023f67d2b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.886554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea210ba-5b55-4982-b1e5-f023f67d2b24 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.887129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea210ba-5b55-4982-b1e5-f023f67d2b24 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.887600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea210ba-5b55-4982-b1e5-f023f67d2b24 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.889149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea210ba-5b55-4982-b1e5-f023f67d2b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:17.889643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea210ba-5b55-4982-b1e5-f023f67d2b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.891367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea210ba-5b55-4982-b1e5-f023f67d2b24 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.905806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 361/699] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:17.907057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea210ba-5b55-4982-b1e5-f023f67d2b24 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.957941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0afc-5295-468d-98c8-98fba114ad8b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.970616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.997803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa732-d8f0-4e3c-990e-a208a1647afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.998258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa732-d8f0-4e3c-990e-a208a1647afa None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.998615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa732-d8f0-4e3c-990e-a208a1647afa None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.998969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa732-d8f0-4e3c-990e-a208a1647afa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.010810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fa732-d8f0-4e3c-990e-a208a1647afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.012568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fa732-d8f0-4e3c-990e-a208a1647afa None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.022132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-c30fa732-d8f0-4e3c-990e-a208a1647afa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:18.032795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:18.033776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:18.034987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:18.034987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:18.034987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:18.034987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:18.040007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 339/700] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:18.041404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa732-d8f0-4e3c-990e-a208a1647afa None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.045716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea210ba-5b55-4982-b1e5-f023f67d2b24 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.087055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbc022-0fbe-45aa-9348-8ee9ffdea934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.088075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbc022-0fbe-45aa-9348-8ee9ffdea934 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.088563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbc022-0fbe-45aa-9348-8ee9ffdea934 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.089011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbc022-0fbe-45aa-9348-8ee9ffdea934 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.089940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbc022-0fbe-45aa-9348-8ee9ffdea934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:18.090551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbc022-0fbe-45aa-9348-8ee9ffdea934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.093079 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbc022-0fbe-45aa-9348-8ee9ffdea934 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.107533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 362/701] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:18.108772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbc022-0fbe-45aa-9348-8ee9ffdea934 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.168172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa732-d8f0-4e3c-990e-a208a1647afa None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.216760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861c9f3-160c-416a-b0f6-22b2654b2a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.218090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861c9f3-160c-416a-b0f6-22b2654b2a11 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.218549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861c9f3-160c-416a-b0f6-22b2654b2a11 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.219467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861c9f3-160c-416a-b0f6-22b2654b2a11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.228724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861c9f3-160c-416a-b0f6-22b2654b2a11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.231143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861c9f3-160c-416a-b0f6-22b2654b2a11 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.245045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbc022-0fbe-45aa-9348-8ee9ffdea934 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-1861c9f3-160c-416a-b0f6-22b2654b2a11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:18.252461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:18.253573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:18.254667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:18.254667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:18.254667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:18.254667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:18.254667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:18.254667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:18.254667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:18.254667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:18.257593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 340/702] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:18.258678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861c9f3-160c-416a-b0f6-22b2654b2a11 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.264736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:18.302546 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98322add-466e-4c9f-83d8-802b2a392548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.303382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98322add-466e-4c9f-83d8-802b2a392548 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.303786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98322add-466e-4c9f-83d8-802b2a392548 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.304375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98322add-466e-4c9f-83d8-802b2a392548 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.305510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98322add-466e-4c9f-83d8-802b2a392548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:18.305892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98322add-466e-4c9f-83d8-802b2a392548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.307854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98322add-466e-4c9f-83d8-802b2a392548 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.331259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 363/703] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:18.332337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98322add-466e-4c9f-83d8-802b2a392548 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.357485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:18.415225 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861c9f3-160c-416a-b0f6-22b2654b2a11 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.455543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25eb98-e337-463f-9966-64aef77b0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.456422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25eb98-e337-463f-9966-64aef77b0aad None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.456703 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25eb98-e337-463f-9966-64aef77b0aad None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.456971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25eb98-e337-463f-9966-64aef77b0aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.464258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25eb98-e337-463f-9966-64aef77b0aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.466948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25eb98-e337-463f-9966-64aef77b0aad None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-1e25eb98-e337-463f-9966-64aef77b0aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:18.484636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:18.485619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:18.486528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:18.486528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:18.486528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:18.486528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:18.486528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:18.486528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:18.486528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:18.486528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:18.487869 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98322add-466e-4c9f-83d8-802b2a392548 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.493573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 341/704] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:18.493573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25eb98-e337-463f-9966-64aef77b0aad None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.533694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7074f-b21b-4104-9291-8704c1f539bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.534610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7074f-b21b-4104-9291-8704c1f539bd None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.534962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7074f-b21b-4104-9291-8704c1f539bd None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.535400 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7074f-b21b-4104-9291-8704c1f539bd None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.536379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7074f-b21b-4104-9291-8704c1f539bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:18.536787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7074f-b21b-4104-9291-8704c1f539bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.538485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7074f-b21b-4104-9291-8704c1f539bd None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.552157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 364/705] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:18.554289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51032d-f7c6-4b5e-a435-2b625907ca3c None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.554807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51032d-f7c6-4b5e-a435-2b625907ca3c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.555694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51032d-f7c6-4b5e-a435-2b625907ca3c None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.558038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 365/706] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:18.560266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51032d-f7c6-4b5e-a435-2b625907ca3c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.592208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:18.613350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25eb98-e337-463f-9966-64aef77b0aad None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.640171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:18.657023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ff80c-228f-4c4c-a48e-417d75765060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.657699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ff80c-228f-4c4c-a48e-417d75765060 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.657984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ff80c-228f-4c4c-a48e-417d75765060 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.658259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ff80c-228f-4c4c-a48e-417d75765060 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.658976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ff80c-228f-4c4c-a48e-417d75765060 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.660456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ff80c-228f-4c4c-a48e-417d75765060 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.676138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51032d-f7c6-4b5e-a435-2b625907ca3c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.714229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf117f-27f1-4b8d-ad8d-7f7093452e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.714888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf117f-27f1-4b8d-ad8d-7f7093452e00 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.715170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf117f-27f1-4b8d-ad8d-7f7093452e00 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.715441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf117f-27f1-4b8d-ad8d-7f7093452e00 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.716310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf117f-27f1-4b8d-ad8d-7f7093452e00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:18.716868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf117f-27f1-4b8d-ad8d-7f7093452e00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.718356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf117f-27f1-4b8d-ad8d-7f7093452e00 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.731056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 366/707] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:18.732198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf117f-27f1-4b8d-ad8d-7f7093452e00 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.827594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 342/708] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:43:18 2022] POST /identity/v3/users => generated 254 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:18.827594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2da98-b357-475b-bdb1-e52ac3f82282 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.827594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2da98-b357-475b-bdb1-e52ac3f82282 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.827594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2da98-b357-475b-bdb1-e52ac3f82282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.840142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0fa2da98-b357-475b-bdb1-e52ac3f82282 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:18.841803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0fa2da98-b357-475b-bdb1-e52ac3f82282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:18.854821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:18.873000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf117f-27f1-4b8d-ad8d-7f7093452e00 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.917922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a33e5c-59b3-4a09-b1ce-45d5b03f7029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.918850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a33e5c-59b3-4a09-b1ce-45d5b03f7029 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.919925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a33e5c-59b3-4a09-b1ce-45d5b03f7029 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.920270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a33e5c-59b3-4a09-b1ce-45d5b03f7029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.921215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a33e5c-59b3-4a09-b1ce-45d5b03f7029 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=8dd8a5a74a2947e385ca0cb7f3ee6428) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:18.922066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a33e5c-59b3-4a09-b1ce-45d5b03f7029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.924028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a33e5c-59b3-4a09-b1ce-45d5b03f7029 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.924580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 343/709] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:18.925614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2da98-b357-475b-bdb1-e52ac3f82282 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.940648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 367/710] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/role_assignments?user.id=8dd8a5a74a2947e385ca0cb7f3ee6428&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:18.982897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a33e5c-59b3-4a09-b1ce-45d5b03f7029 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.065076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2da98-b357-475b-bdb1-e52ac3f82282 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.076348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:19.112540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d2fa1-1a71-4f5e-87dc-25fe316c7d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.114112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d2fa1-1a71-4f5e-87dc-25fe316c7d18 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.114620 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d2fa1-1a71-4f5e-87dc-25fe316c7d18 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.115463 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d2fa1-1a71-4f5e-87dc-25fe316c7d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.116673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d2fa1-1a71-4f5e-87dc-25fe316c7d18 None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=45cfc967b8634e60b3ddfe4168a748b4) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:19.117742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d2fa1-1a71-4f5e-87dc-25fe316c7d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.119703 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d2fa1-1a71-4f5e-87dc-25fe316c7d18 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.131403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 344/711] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/role_assignments?user.id=45cfc967b8634e60b3ddfe4168a748b4&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:19.133510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b37fc-e8b7-40af-9f19-62086681d79d None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.133823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b37fc-e8b7-40af-9f19-62086681d79d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.134183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b37fc-e8b7-40af-9f19-62086681d79d None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.138396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 345/712] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:19.145653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddf95c-786a-4ad6-867b-901b563a6c75 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.146499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddf95c-786a-4ad6-867b-901b563a6c75 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.147095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddf95c-786a-4ad6-867b-901b563a6c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.148621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a33e5c-59b3-4a09-b1ce-45d5b03f7029 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.174042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-50ddf95c-786a-4ad6-867b-901b563a6c75 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:19.175855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-50ddf95c-786a-4ad6-867b-901b563a6c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:19.210721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311eb408-ea1c-4a86-959b-e8d53fb28ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.211998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb408-ea1c-4a86-959b-e8d53fb28ce6 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.212296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb408-ea1c-4a86-959b-e8d53fb28ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.212551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb408-ea1c-4a86-959b-e8d53fb28ce6 None admin] PATH_INFO: `/v3/services/network` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.213215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311eb408-ea1c-4a86-959b-e8d53fb28ce6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.214603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311eb408-ea1c-4a86-959b-e8d53fb28ce6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-311eb408-ea1c-4a86-959b-e8d53fb28ce6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:19.236284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:19.237498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:19.238412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 368/713] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:18 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:19.244637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311eb408-ea1c-4a86-959b-e8d53fb28ce6 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.284335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:19.292326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 346/714] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:43:19.333411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddf95c-786a-4ad6-867b-901b563a6c75 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.414211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311eb408-ea1c-4a86-959b-e8d53fb28ce6 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.460683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:19.462883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd43759-3e50-494a-88a6-af7780c14db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.463796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddf95c-786a-4ad6-867b-901b563a6c75 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.464305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd43759-3e50-494a-88a6-af7780c14db4 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.464745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd43759-3e50-494a-88a6-af7780c14db4 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.465170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd43759-3e50-494a-88a6-af7780c14db4 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.467108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd43759-3e50-494a-88a6-af7780c14db4 None admin] RBAC: Adding query filter params (name=network) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:19.467589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd43759-3e50-494a-88a6-af7780c14db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.470433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd43759-3e50-494a-88a6-af7780c14db4 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.478243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 369/715] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:19.484292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd43759-3e50-494a-88a6-af7780c14db4 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.508247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627f59d-28b4-491e-ba04-721a3cde1db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.509143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627f59d-28b4-491e-ba04-721a3cde1db3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.509517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627f59d-28b4-491e-ba04-721a3cde1db3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.509888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627f59d-28b4-491e-ba04-721a3cde1db3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.511704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627f59d-28b4-491e-ba04-721a3cde1db3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.514362 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627f59d-28b4-491e-ba04-721a3cde1db3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9627f59d-28b4-491e-ba04-721a3cde1db3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:19.533036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:19.534366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:43:19.535363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:19.536234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 347/716] 10.222.0.93 () {56 vars in 1129 bytes} [Thu May 26 16:43:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:19.543785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627f59d-28b4-491e-ba04-721a3cde1db3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.601485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:19.632359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd43759-3e50-494a-88a6-af7780c14db4 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.679477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627f59d-28b4-491e-ba04-721a3cde1db3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.685596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf9fa7-a546-4de9-841c-74b99c231d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.686573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf9fa7-a546-4de9-841c-74b99c231d7c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.687108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf9fa7-a546-4de9-841c-74b99c231d7c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.687602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf9fa7-a546-4de9-841c-74b99c231d7c None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.688639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf9fa7-a546-4de9-841c-74b99c231d7c None admin] RBAC: Adding query filter params (type=network) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:19.689143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf9fa7-a546-4de9-841c-74b99c231d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.692950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf9fa7-a546-4de9-841c-74b99c231d7c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.699693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 370/717] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:19.737953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a1588-a450-42f3-bb5c-ab7ecaa5b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.738818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a1588-a450-42f3-bb5c-ab7ecaa5b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.739178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a1588-a450-42f3-bb5c-ab7ecaa5b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.739607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a1588-a450-42f3-bb5c-ab7ecaa5b4e5 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.740555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a1588-a450-42f3-bb5c-ab7ecaa5b4e5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:19.740936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a1588-a450-42f3-bb5c-ab7ecaa5b4e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.742420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a1588-a450-42f3-bb5c-ab7ecaa5b4e5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.748511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 348/718] 10.222.0.93 () {56 vars in 1124 bytes} [Thu May 26 16:43:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:19.754390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf9fa7-a546-4de9-841c-74b99c231d7c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.922852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf9fa7-a546-4de9-841c-74b99c231d7c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.977528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28493870-3683-4de9-95d2-5523b758978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.978334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28493870-3683-4de9-95d2-5523b758978d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.978658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28493870-3683-4de9-95d2-5523b758978d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.978971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28493870-3683-4de9-95d2-5523b758978d None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.979772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28493870-3683-4de9-95d2-5523b758978d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:19.980080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28493870-3683-4de9-95d2-5523b758978d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.981575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28493870-3683-4de9-95d2-5523b758978d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.988174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 371/719] 10.222.0.93 () {56 vars in 1124 bytes} [Thu May 26 16:43:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:21.722059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50013e4-ac2b-4c1a-aa48-d01d91d3d2df None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.722562 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50013e4-ac2b-4c1a-aa48-d01d91d3d2df None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.722640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50013e4-ac2b-4c1a-aa48-d01d91d3d2df None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.724315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 349/720] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:21.730079 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24ec0d-a5d1-4024-a689-f699aaad34dd None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.730917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24ec0d-a5d1-4024-a689-f699aaad34dd None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.731434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24ec0d-a5d1-4024-a689-f699aaad34dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.759994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3e24ec0d-a5d1-4024-a689-f699aaad34dd None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:21.761193 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3e24ec0d-a5d1-4024-a689-f699aaad34dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:21.764115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:21.778966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88ff23-77f8-4c04-b420-957f96ea4d64 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.779594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88ff23-77f8-4c04-b420-957f96ea4d64 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.780170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88ff23-77f8-4c04-b420-957f96ea4d64 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.791239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 350/721] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:43:21.791239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f13fb8-1400-445d-9081-ddf38b5644d1 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:21.791239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f13fb8-1400-445d-9081-ddf38b5644d1 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:21.791239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f13fb8-1400-445d-9081-ddf38b5644d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:21.824425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-80f13fb8-1400-445d-9081-ddf38b5644d1 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:21.826210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-80f13fb8-1400-445d-9081-ddf38b5644d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:21.854288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:21.903111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 372/722] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:43:21.930657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 351/723] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:43:21.963941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24ec0d-a5d1-4024-a689-f699aaad34dd None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:21.967924 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f13fb8-1400-445d-9081-ddf38b5644d1 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.143184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24ec0d-a5d1-4024-a689-f699aaad34dd None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.205279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88413d1-4496-49eb-8d52-039fef0fe5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.206206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88413d1-4496-49eb-8d52-039fef0fe5c5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.206547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88413d1-4496-49eb-8d52-039fef0fe5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.206927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88413d1-4496-49eb-8d52-039fef0fe5c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.221688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f13fb8-1400-445d-9081-ddf38b5644d1 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.228151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:22.236885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88413d1-4496-49eb-8d52-039fef0fe5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-c88413d1-4496-49eb-8d52-039fef0fe5c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:22.244765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:22.245956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:22.246836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 373/724] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:22.248134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b626cc-eee1-45a7-9fe9-5f8bd1980b9d None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.248134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b626cc-eee1-45a7-9fe9-5f8bd1980b9d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.248331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b626cc-eee1-45a7-9fe9-5f8bd1980b9d None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.253322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 374/725] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:22.254833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b626cc-eee1-45a7-9fe9-5f8bd1980b9d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.270530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf0a46-0e7d-47f6-badd-616a54cf690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.271637 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0a46-0e7d-47f6-badd-616a54cf690e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.271933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0a46-0e7d-47f6-badd-616a54cf690e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.272252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0a46-0e7d-47f6-badd-616a54cf690e None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.286557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf0a46-0e7d-47f6-badd-616a54cf690e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-e2bf0a46-0e7d-47f6-badd-616a54cf690e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:22.295645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:22.298115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 352/726] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:22.299506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0c39-9517-4494-a5ea-fe4c0892f158 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.300565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0c39-9517-4494-a5ea-fe4c0892f158 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.300565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0c39-9517-4494-a5ea-fe4c0892f158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.322508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a03e0c39-9517-4494-a5ea-fe4c0892f158 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:22.324121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a03e0c39-9517-4494-a5ea-fe4c0892f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:22.343426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:22.409520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b626cc-eee1-45a7-9fe9-5f8bd1980b9d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.413432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 353/727] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:22.414414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0c39-9517-4494-a5ea-fe4c0892f158 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.469764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a4f35-8bfb-4a2f-9e62-d264ee82e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.471526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a4f35-8bfb-4a2f-9e62-d264ee82e591 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.471963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a4f35-8bfb-4a2f-9e62-d264ee82e591 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.472261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a4f35-8bfb-4a2f-9e62-d264ee82e591 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.473212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a4f35-8bfb-4a2f-9e62-d264ee82e591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:22.473591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a4f35-8bfb-4a2f-9e62-d264ee82e591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.475153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a4f35-8bfb-4a2f-9e62-d264ee82e591 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:22.490837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 375/728] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:22.491806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a4f35-8bfb-4a2f-9e62-d264ee82e591 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.563432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0c39-9517-4494-a5ea-fe4c0892f158 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.565144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:22.610387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a4f35-8bfb-4a2f-9e62-d264ee82e591 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.612566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611194b-95d7-4b93-9e7a-f6b7763cd708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.613459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611194b-95d7-4b93-9e7a-f6b7763cd708 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.614019 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611194b-95d7-4b93-9e7a-f6b7763cd708 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.614569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611194b-95d7-4b93-9e7a-f6b7763cd708 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.615928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611194b-95d7-4b93-9e7a-f6b7763cd708 None admin] RBAC: Adding query filter params (name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:22.616386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611194b-95d7-4b93-9e7a-f6b7763cd708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.618107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611194b-95d7-4b93-9e7a-f6b7763cd708 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:22.630884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 354/729] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:22.632309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611194b-95d7-4b93-9e7a-f6b7763cd708 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.648575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211b19-0884-4239-9b46-13c2ba3c9779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.649374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211b19-0884-4239-9b46-13c2ba3c9779 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.649654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211b19-0884-4239-9b46-13c2ba3c9779 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.649909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211b19-0884-4239-9b46-13c2ba3c9779 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.650432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:22.662690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12211b19-0884-4239-9b46-13c2ba3c9779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-12211b19-0884-4239-9b46-13c2ba3c9779 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:22.673275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:22.676423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:22.679794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:22.693521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 376/730] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:22.693521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211b19-0884-4239-9b46-13c2ba3c9779 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.798129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211b19-0884-4239-9b46-13c2ba3c9779 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.800691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611194b-95d7-4b93-9e7a-f6b7763cd708 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:22.822787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:22.838070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e771627-0c27-42d5-b590-402111234f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.841370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d79dc2-08a0-4840-8d79-23ba59fb0c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:22.841756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e771627-0c27-42d5-b590-402111234f08 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.841756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e771627-0c27-42d5-b590-402111234f08 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.841900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d79dc2-08a0-4840-8d79-23ba59fb0c4b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:22.841987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e771627-0c27-42d5-b590-402111234f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.842063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d79dc2-08a0-4840-8d79-23ba59fb0c4b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:22.842063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d79dc2-08a0-4840-8d79-23ba59fb0c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:22.852595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d79dc2-08a0-4840-8d79-23ba59fb0c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.854095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d79dc2-08a0-4840-8d79-23ba59fb0c4b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-57d79dc2-08a0-4840-8d79-23ba59fb0c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:22.874541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:22.875540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:22.877278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:22.877278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:22.877278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:22.877278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:22.879982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 355/731] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:22.881339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d79dc2-08a0-4840-8d79-23ba59fb0c4b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:22.956354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:22.977363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e771627-0c27-42d5-b590-402111234f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:22.978936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e771627-0c27-42d5-b590-402111234f08 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-8e771627-0c27-42d5-b590-402111234f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:22.998346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:23.009236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:23.011233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:23.011233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:23.011233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:23.011233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:23.011233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 377/732] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:23.011233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6b32d-dc64-425d-bbff-4b52c9d48fbb None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.011233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6b32d-dc64-425d-bbff-4b52c9d48fbb None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.012132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d79dc2-08a0-4840-8d79-23ba59fb0c4b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.012283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6b32d-dc64-425d-bbff-4b52c9d48fbb None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.012283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 378/733] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:23.012283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6b32d-dc64-425d-bbff-4b52c9d48fbb None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.052806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0096d8e-2424-4268-8017-225d7ac2f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.053506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096d8e-2424-4268-8017-225d7ac2f42b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.053797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096d8e-2424-4268-8017-225d7ac2f42b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.054075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096d8e-2424-4268-8017-225d7ac2f42b None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.054829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096d8e-2424-4268-8017-225d7ac2f42b None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:23.055140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096d8e-2424-4268-8017-225d7ac2f42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.057110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096d8e-2424-4268-8017-225d7ac2f42b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.067930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 356/734] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:23.068704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0096d8e-2424-4268-8017-225d7ac2f42b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.128877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6b32d-dc64-425d-bbff-4b52c9d48fbb None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.165632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b29612-6ea8-445d-9dfe-42246490e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.166301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b29612-6ea8-445d-9dfe-42246490e73d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.166580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b29612-6ea8-445d-9dfe-42246490e73d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.166849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b29612-6ea8-445d-9dfe-42246490e73d None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.167600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b29612-6ea8-445d-9dfe-42246490e73d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:23.167899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b29612-6ea8-445d-9dfe-42246490e73d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.169446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b29612-6ea8-445d-9dfe-42246490e73d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.182156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 379/735] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:23.183340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0096d8e-2424-4268-8017-225d7ac2f42b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.183529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9405c9e-7c37-48cb-ae48-346ac96a2da2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.183853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9405c9e-7c37-48cb-ae48-346ac96a2da2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.184130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9405c9e-7c37-48cb-ae48-346ac96a2da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.202411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d9405c9e-7c37-48cb-ae48-346ac96a2da2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:23.203646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d9405c9e-7c37-48cb-ae48-346ac96a2da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:23.215323 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:23.228716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729652f-210a-4da5-b053-f67512144e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.229388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729652f-210a-4da5-b053-f67512144e62 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.229672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729652f-210a-4da5-b053-f67512144e62 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.229956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729652f-210a-4da5-b053-f67512144e62 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.231226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729652f-210a-4da5-b053-f67512144e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:23.231226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729652f-210a-4da5-b053-f67512144e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.233181 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729652f-210a-4da5-b053-f67512144e62 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.235786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:23.246794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 357/736] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:23.248185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729652f-210a-4da5-b053-f67512144e62 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.283263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 380/737] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:23.284334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9405c9e-7c37-48cb-ae48-346ac96a2da2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.354286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729652f-210a-4da5-b053-f67512144e62 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.384944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9405c9e-7c37-48cb-ae48-346ac96a2da2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.389752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a802c-eeea-4e59-af14-ea99ddaadb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.390597 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a802c-eeea-4e59-af14-ea99ddaadb03 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.390888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a802c-eeea-4e59-af14-ea99ddaadb03 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.391166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a802c-eeea-4e59-af14-ea99ddaadb03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.402883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a802c-eeea-4e59-af14-ea99ddaadb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.404526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a802c-eeea-4e59-af14-ea99ddaadb03 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.421312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40c25-5a6f-414a-bd36-db680a17f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.422102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40c25-5a6f-414a-bd36-db680a17f4df None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.422384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40c25-5a6f-414a-bd36-db680a17f4df None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.422658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40c25-5a6f-414a-bd36-db680a17f4df None admin] PATH_INFO: `/v3/users/nova` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-414a802c-eeea-4e59-af14-ea99ddaadb03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:23.426433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:23.428334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:23.431478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:23.431478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:23.431478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:23.431478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:23.431478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 358/738] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:23.431478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10c8b-62d1-4073-874d-b51bed47a16e None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.431478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10c8b-62d1-4073-874d-b51bed47a16e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.433614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec40c25-5a6f-414a-bd36-db680a17f4df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.433780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10c8b-62d1-4073-874d-b51bed47a16e None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.433935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec40c25-5a6f-414a-bd36-db680a17f4df None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.434353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 359/739] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:23.436124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed10c8b-62d1-4073-874d-b51bed47a16e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-cec40c25-5a6f-414a-bd36-db680a17f4df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:23.449189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:23.450566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 381/740] 10.222.0.93 () {56 vars in 1093 bytes} [Thu May 26 16:43:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:23.451943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40c25-5a6f-414a-bd36-db680a17f4df None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.476735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:23.478584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:23.546595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed10c8b-62d1-4073-874d-b51bed47a16e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.552946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40c25-5a6f-414a-bd36-db680a17f4df None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.583517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8343b8-2dce-4df5-874e-0063402d082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.584344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8343b8-2dce-4df5-874e-0063402d082d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.584664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8343b8-2dce-4df5-874e-0063402d082d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.584895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8343b8-2dce-4df5-874e-0063402d082d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.587007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86fc1c-b996-440d-bd87-651c78857c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.587709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fc1c-b996-440d-bd87-651c78857c45 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.587996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fc1c-b996-440d-bd87-651c78857c45 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.588275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fc1c-b996-440d-bd87-651c78857c45 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.588997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86fc1c-b996-440d-bd87-651c78857c45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.590376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86fc1c-b996-440d-bd87-651c78857c45 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.592590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8343b8-2dce-4df5-874e-0063402d082d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.594032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8343b8-2dce-4df5-874e-0063402d082d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-8f8343b8-2dce-4df5-874e-0063402d082d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:23.618057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:23.619209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 360/741] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:43:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:23.620234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8343b8-2dce-4df5-874e-0063402d082d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.706225 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:23.712201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8343b8-2dce-4df5-874e-0063402d082d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.725709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 382/742] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:43:23 2022] POST /identity/v3/services => generated 240 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:23.727012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603070d9-6bf8-4a61-8786-01d27f038a47 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.727303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603070d9-6bf8-4a61-8786-01d27f038a47 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.727618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603070d9-6bf8-4a61-8786-01d27f038a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.758569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-603070d9-6bf8-4a61-8786-01d27f038a47 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:23.760198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-603070d9-6bf8-4a61-8786-01d27f038a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:23.769234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e6818-5748-4768-ad15-d78c730a44fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.770844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e6818-5748-4768-ad15-d78c730a44fc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.771353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e6818-5748-4768-ad15-d78c730a44fc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.771842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e6818-5748-4768-ad15-d78c730a44fc None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.773244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e6818-5748-4768-ad15-d78c730a44fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:23.774071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e6818-5748-4768-ad15-d78c730a44fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.776032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e6818-5748-4768-ad15-d78c730a44fc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.798692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 361/743] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:23.800042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e6818-5748-4768-ad15-d78c730a44fc None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.851029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 383/744] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:23 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:43:23.852774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603070d9-6bf8-4a61-8786-01d27f038a47 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:23.874435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:23.941075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e6818-5748-4768-ad15-d78c730a44fc None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:23.979996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865ea80-d696-4990-a270-a444b67eac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:23.980659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865ea80-d696-4990-a270-a444b67eac8e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:23.980941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865ea80-d696-4990-a270-a444b67eac8e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:23.981210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865ea80-d696-4990-a270-a444b67eac8e None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:23.982800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865ea80-d696-4990-a270-a444b67eac8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:23.982924 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865ea80-d696-4990-a270-a444b67eac8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:23.984411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865ea80-d696-4990-a270-a444b67eac8e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:23.987470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603070d9-6bf8-4a61-8786-01d27f038a47 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:24.022382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6ab0-c00d-4212-a5ff-4008c77d2270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:24.023074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6ab0-c00d-4212-a5ff-4008c77d2270 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:24.023358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6ab0-c00d-4212-a5ff-4008c77d2270 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:24.023668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6ab0-c00d-4212-a5ff-4008c77d2270 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:24.024535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd6ab0-c00d-4212-a5ff-4008c77d2270 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:24.024839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd6ab0-c00d-4212-a5ff-4008c77d2270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:24.026315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd6ab0-c00d-4212-a5ff-4008c77d2270 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:24.077816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 362/745] 10.222.0.93 () {56 vars in 1133 bytes} [Thu May 26 16:43:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:24.077816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865ea80-d696-4990-a270-a444b67eac8e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:24.078106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 384/746] 10.222.0.93 () {56 vars in 1149 bytes} [Thu May 26 16:43:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:24.078106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6ab0-c00d-4212-a5ff-4008c77d2270 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:24.096343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:24.162175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:24.195684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6ab0-c00d-4212-a5ff-4008c77d2270 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:24.208150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865ea80-d696-4990-a270-a444b67eac8e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:24.242404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115d67-45a0-49ce-b20c-8c6dfa12c7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:24.243073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115d67-45a0-49ce-b20c-8c6dfa12c7c1 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:24.243376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115d67-45a0-49ce-b20c-8c6dfa12c7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:24.243685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115d67-45a0-49ce-b20c-8c6dfa12c7c1 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:24.244419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc115d67-45a0-49ce-b20c-8c6dfa12c7c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:24.245874 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc115d67-45a0-49ce-b20c-8c6dfa12c7c1 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:24.253057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bbaea-4104-41f6-8030-353d23097e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:24.254118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bbaea-4104-41f6-8030-353d23097e2f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:24.254528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bbaea-4104-41f6-8030-353d23097e2f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:24.254979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bbaea-4104-41f6-8030-353d23097e2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:24.266112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bbaea-4104-41f6-8030-353d23097e2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:24.267793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bbaea-4104-41f6-8030-353d23097e2f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-776bbaea-4104-41f6-8030-353d23097e2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:24.285706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:24.286920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 363/747] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:24.288050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bbaea-4104-41f6-8030-353d23097e2f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:24.355606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 385/748] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:43:24 2022] POST /identity/v3/services => generated 251 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:24.357295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115d67-45a0-49ce-b20c-8c6dfa12c7c1 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:24.387422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:24.428665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bbaea-4104-41f6-8030-353d23097e2f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:24.479581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747316-4034-4b67-9860-ce0cafe4af14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:24.480661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747316-4034-4b67-9860-ce0cafe4af14 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:24.481161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747316-4034-4b67-9860-ce0cafe4af14 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:24.482447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747316-4034-4b67-9860-ce0cafe4af14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:24.506549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115d67-45a0-49ce-b20c-8c6dfa12c7c1 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:24.542216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:24.551306 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772451a3-77b5-414c-ba84-25340081900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:24.553019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772451a3-77b5-414c-ba84-25340081900d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:24.554032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772451a3-77b5-414c-ba84-25340081900d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:24.554032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772451a3-77b5-414c-ba84-25340081900d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:24.566400 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772451a3-77b5-414c-ba84-25340081900d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:24.568248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772451a3-77b5-414c-ba84-25340081900d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:24.579355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f747316-4034-4b67-9860-ce0cafe4af14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:24.581255 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f747316-4034-4b67-9860-ce0cafe4af14 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-772451a3-77b5-414c-ba84-25340081900d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:24.588104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:24.589060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:24.589970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:24.589970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:24.589970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:24.589970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:24.589970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 386/749] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:24.590249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772451a3-77b5-414c-ba84-25340081900d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:24.677958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:24.724894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 364/750] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:43:24.726125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747316-4034-4b67-9860-ce0cafe4af14 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:24.737131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772451a3-77b5-414c-ba84-25340081900d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:24.790351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52a66-2eca-4a9b-9500-d718996dd10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:24.791135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52a66-2eca-4a9b-9500-d718996dd10b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:24.791422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52a66-2eca-4a9b-9500-d718996dd10b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:24.791747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52a66-2eca-4a9b-9500-d718996dd10b None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:24.792832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52a66-2eca-4a9b-9500-d718996dd10b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:24.793039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52a66-2eca-4a9b-9500-d718996dd10b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:24.795025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52a66-2eca-4a9b-9500-d718996dd10b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:24.815539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 387/751] 10.222.0.93 () {56 vars in 1135 bytes} [Thu May 26 16:43:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:24.817153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52a66-2eca-4a9b-9500-d718996dd10b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:24.853210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747316-4034-4b67-9860-ce0cafe4af14 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:24.865597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:24.892234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ca2eb-5e09-43f0-b30a-584c0212496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:24.893066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ca2eb-5e09-43f0-b30a-584c0212496b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:24.893488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ca2eb-5e09-43f0-b30a-584c0212496b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:24.893886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ca2eb-5e09-43f0-b30a-584c0212496b None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:24.895137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ca2eb-5e09-43f0-b30a-584c0212496b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:24.895438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ca2eb-5e09-43f0-b30a-584c0212496b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:24.897098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ca2eb-5e09-43f0-b30a-584c0212496b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:24.916226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 365/752] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:24.916226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ca2eb-5e09-43f0-b30a-584c0212496b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.026319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:25.034840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52a66-2eca-4a9b-9500-d718996dd10b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.074643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d234f-72d9-420b-bd9c-d9cfe74ed27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.076519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d234f-72d9-420b-bd9c-d9cfe74ed27d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.077025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d234f-72d9-420b-bd9c-d9cfe74ed27d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.077508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d234f-72d9-420b-bd9c-d9cfe74ed27d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.090116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d234f-72d9-420b-bd9c-d9cfe74ed27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.092888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d234f-72d9-420b-bd9c-d9cfe74ed27d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.111759 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ca2eb-5e09-43f0-b30a-584c0212496b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-631d234f-72d9-420b-bd9c-d9cfe74ed27d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:25.112933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:25.113819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:25.114737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:25.114737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:25.114737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:25.114737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:25.117184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 388/753] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:25.118330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d234f-72d9-420b-bd9c-d9cfe74ed27d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.155540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0248fd3-c0ba-4802-878d-094a82765d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.156354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0248fd3-c0ba-4802-878d-094a82765d74 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.156640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0248fd3-c0ba-4802-878d-094a82765d74 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.156916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0248fd3-c0ba-4802-878d-094a82765d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.220515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:25.230346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d234f-72d9-420b-bd9c-d9cfe74ed27d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.245892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0248fd3-c0ba-4802-878d-094a82765d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.248209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0248fd3-c0ba-4802-878d-094a82765d74 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.276180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a8f1-f472-4ec2-8f5a-808010e5a409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.277500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a8f1-f472-4ec2-8f5a-808010e5a409 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.277982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a8f1-f472-4ec2-8f5a-808010e5a409 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.278507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a8f1-f472-4ec2-8f5a-808010e5a409 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.279275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:25.287935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a8f1-f472-4ec2-8f5a-808010e5a409 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.289672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a8f1-f472-4ec2-8f5a-808010e5a409 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-1488a8f1-f472-4ec2-8f5a-808010e5a409 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:25.304297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:25.305280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:25.306275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:25.306275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:25.306275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:25.306275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:25.306275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:25.306275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:25.306275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:25.306275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:25.314015 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 389/754] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:25.315103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a8f1-f472-4ec2-8f5a-808010e5a409 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.364773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 366/755] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:43:25.365835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0248fd3-c0ba-4802-878d-094a82765d74 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.424956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a8f1-f472-4ec2-8f5a-808010e5a409 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.466347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae73c6-11b9-44c2-adbb-3f6e948511f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.467664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae73c6-11b9-44c2-adbb-3f6e948511f4 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.468207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae73c6-11b9-44c2-adbb-3f6e948511f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.468721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae73c6-11b9-44c2-adbb-3f6e948511f4 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.469847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae73c6-11b9-44c2-adbb-3f6e948511f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:25.470349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae73c6-11b9-44c2-adbb-3f6e948511f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.472214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae73c6-11b9-44c2-adbb-3f6e948511f4 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.480999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0248fd3-c0ba-4802-878d-094a82765d74 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.486760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 390/756] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:25.487969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae73c6-11b9-44c2-adbb-3f6e948511f4 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.504036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:25.516720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:25.526358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a20ba-b88c-415e-8366-aa0785d3f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.527236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a20ba-b88c-415e-8366-aa0785d3f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.527619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a20ba-b88c-415e-8366-aa0785d3f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.527886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a20ba-b88c-415e-8366-aa0785d3f6c0 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.529554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a20ba-b88c-415e-8366-aa0785d3f6c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:25.529878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a20ba-b88c-415e-8366-aa0785d3f6c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.531326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a20ba-b88c-415e-8366-aa0785d3f6c0 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.553275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 367/757] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:25.553275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a20ba-b88c-415e-8366-aa0785d3f6c0 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.610133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae73c6-11b9-44c2-adbb-3f6e948511f4 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.684402 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305dc5e-4198-4180-9ecd-ceab449320bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.686861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305dc5e-4198-4180-9ecd-ceab449320bd None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.687665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305dc5e-4198-4180-9ecd-ceab449320bd None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.688340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305dc5e-4198-4180-9ecd-ceab449320bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.703017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305dc5e-4198-4180-9ecd-ceab449320bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.704962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305dc5e-4198-4180-9ecd-ceab449320bd None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.712766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a20ba-b88c-415e-8366-aa0785d3f6c0 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-7305dc5e-4198-4180-9ecd-ceab449320bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:25.725575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:25.726519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:25.727428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:25.727428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:25.727428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:25.727428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:25.729775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 391/758] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:25.730789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305dc5e-4198-4180-9ecd-ceab449320bd None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.776010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b578-68ae-4174-a571-6a393ec836c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.776904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b578-68ae-4174-a571-6a393ec836c8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.777187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b578-68ae-4174-a571-6a393ec836c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.777463 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b578-68ae-4174-a571-6a393ec836c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.787152 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49b578-68ae-4174-a571-6a393ec836c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.788874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49b578-68ae-4174-a571-6a393ec836c8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-3d49b578-68ae-4174-a571-6a393ec836c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:25.811251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:25.812358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:25.813514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:25.813514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:25.813514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:25.813514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:25.813514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:25.813514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:25.813514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:25.813514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:25.816394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 368/759] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:25.817361 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b578-68ae-4174-a571-6a393ec836c8 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:25.820578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:25.862333 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305dc5e-4198-4180-9ecd-ceab449320bd None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.886722 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:25.911710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5dd50-f7ba-46ae-a5e9-9bdf9ddb0ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.913912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5dd50-f7ba-46ae-a5e9-9bdf9ddb0ff2 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.914409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5dd50-f7ba-46ae-a5e9-9bdf9ddb0ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.915155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5dd50-f7ba-46ae-a5e9-9bdf9ddb0ff2 None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/8dd8a5a74a2947e385ca0cb7f3ee6428/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.918583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5dd50-f7ba-46ae-a5e9-9bdf9ddb0ff2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=8dd8a5a74a2947e385ca0cb7f3ee6428, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.920892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5dd50-f7ba-46ae-a5e9-9bdf9ddb0ff2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:25.954697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b578-68ae-4174-a571-6a393ec836c8 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:25.994982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554465-c5a7-42b9-b67d-82aab5203d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:25.995683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554465-c5a7-42b9-b67d-82aab5203d97 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:25.995965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554465-c5a7-42b9-b67d-82aab5203d97 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:25.996290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554465-c5a7-42b9-b67d-82aab5203d97 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:25.997092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554465-c5a7-42b9-b67d-82aab5203d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:25.997399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554465-c5a7-42b9-b67d-82aab5203d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:25.998811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554465-c5a7-42b9-b67d-82aab5203d97 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.016789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 369/760] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:26.016789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554465-c5a7-42b9-b67d-82aab5203d97 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.048678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 392/761] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:43:25 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/8dd8a5a74a2947e385ca0cb7f3ee6428/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:26.052123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5dd50-f7ba-46ae-a5e9-9bdf9ddb0ff2 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.232143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5dd50-f7ba-46ae-a5e9-9bdf9ddb0ff2 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:26.259877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554465-c5a7-42b9-b67d-82aab5203d97 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:26.269050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:26.271311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:26.285914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4bc14-674f-410a-896b-cada5463c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:26.287128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4bc14-674f-410a-896b-cada5463c823 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.287664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4bc14-674f-410a-896b-cada5463c823 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.288176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4bc14-674f-410a-896b-cada5463c823 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.297037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4bc14-674f-410a-896b-cada5463c823 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:26.299010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4bc14-674f-410a-896b-cada5463c823 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.300894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b243fcf-e318-43cf-a3a2-f3a0b9ba922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:26.301839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b243fcf-e318-43cf-a3a2-f3a0b9ba922f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.302335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b243fcf-e318-43cf-a3a2-f3a0b9ba922f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.302816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b243fcf-e318-43cf-a3a2-f3a0b9ba922f None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.303847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b243fcf-e318-43cf-a3a2-f3a0b9ba922f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:26.304363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b243fcf-e318-43cf-a3a2-f3a0b9ba922f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:26.306054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b243fcf-e318-43cf-a3a2-f3a0b9ba922f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-e2f4bc14-674f-410a-896b-cada5463c823 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:26.314128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:26.315102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:26.316085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:26.316085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:26.316085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:26.316085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:26.316085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:26.316085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:26.316085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:26.316085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:26.316085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 393/762] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:26.317614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821be8c8-6b9f-43a6-8e17-083a27ead7d7 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.317614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821be8c8-6b9f-43a6-8e17-083a27ead7d7 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.317614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821be8c8-6b9f-43a6-8e17-083a27ead7d7 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.319772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 394/763] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:26.324017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 370/764] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:26.326283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba56bf-5ddc-4529-a46a-b4d61ec9383d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.326813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba56bf-5ddc-4529-a46a-b4d61ec9383d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.327297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba56bf-5ddc-4529-a46a-b4d61ec9383d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.328682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b243fcf-e318-43cf-a3a2-f3a0b9ba922f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.352170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1cba56bf-5ddc-4529-a46a-b4d61ec9383d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:26.353615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1cba56bf-5ddc-4529-a46a-b4d61ec9383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:26.429303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 395/765] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:26.430300 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba56bf-5ddc-4529-a46a-b4d61ec9383d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.452433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b243fcf-e318-43cf-a3a2-f3a0b9ba922f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:26.491068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff5e05-af58-4795-b530-7d4e06d78873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:26.491874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff5e05-af58-4795-b530-7d4e06d78873 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.492165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff5e05-af58-4795-b530-7d4e06d78873 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.492446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff5e05-af58-4795-b530-7d4e06d78873 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.493357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff5e05-af58-4795-b530-7d4e06d78873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:26.493674 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff5e05-af58-4795-b530-7d4e06d78873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:26.495254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff5e05-af58-4795-b530-7d4e06d78873 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.511186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 371/766] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:26.512088 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff5e05-af58-4795-b530-7d4e06d78873 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.541859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba56bf-5ddc-4529-a46a-b4d61ec9383d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:26.548135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:26.560292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:26.583007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617e4b-d2d9-40ed-8463-aef1eeeb46de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:26.584047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617e4b-d2d9-40ed-8463-aef1eeeb46de None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.584590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617e4b-d2d9-40ed-8463-aef1eeeb46de None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.585017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617e4b-d2d9-40ed-8463-aef1eeeb46de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.586053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55617e4b-d2d9-40ed-8463-aef1eeeb46de None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=58fb392b863c48cb9c6ae5c209e9cac3) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:26.586570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55617e4b-d2d9-40ed-8463-aef1eeeb46de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:26.588312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55617e4b-d2d9-40ed-8463-aef1eeeb46de None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.595499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 396/767] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:26 2022] GET /identity/v3/role_assignments?user.id=58fb392b863c48cb9c6ae5c209e9cac3&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:26.597586 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617e4b-d2d9-40ed-8463-aef1eeeb46de None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.638369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff5e05-af58-4795-b530-7d4e06d78873 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:26.691104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9d25-9f5d-4f9c-96df-6433b3c3685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:26.691947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9d25-9f5d-4f9c-96df-6433b3c3685b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.692241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9d25-9f5d-4f9c-96df-6433b3c3685b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.692601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9d25-9f5d-4f9c-96df-6433b3c3685b None admin] PATH_INFO: `/v3/services/network` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.693289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb9d25-9f5d-4f9c-96df-6433b3c3685b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:26.694683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb9d25-9f5d-4f9c-96df-6433b3c3685b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-48eb9d25-9f5d-4f9c-96df-6433b3c3685b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:26.717950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:26.719061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:43:26.719966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:26.727693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 372/768] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:26 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:26.737021 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617e4b-d2d9-40ed-8463-aef1eeeb46de None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:26.737795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9d25-9f5d-4f9c-96df-6433b3c3685b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.779427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d4ee7-7ea7-4339-961f-4325ca12d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:26.780583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d4ee7-7ea7-4339-961f-4325ca12d974 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.781122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d4ee7-7ea7-4339-961f-4325ca12d974 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.781709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d4ee7-7ea7-4339-961f-4325ca12d974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.782911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d4ee7-7ea7-4339-961f-4325ca12d974 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=45cfc967b8634e60b3ddfe4168a748b4) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:26.783482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d4ee7-7ea7-4339-961f-4325ca12d974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:26.785246 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d4ee7-7ea7-4339-961f-4325ca12d974 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.792635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 397/769] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:26 2022] GET /identity/v3/role_assignments?user.id=45cfc967b8634e60b3ddfe4168a748b4&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:26.794910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936d18-52ae-4183-829e-37e64e0f3c2d None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.795540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936d18-52ae-4183-829e-37e64e0f3c2d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.796081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936d18-52ae-4183-829e-37e64e0f3c2d None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.797991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 398/770] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:26.805718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ca6e-b638-425a-8879-dc2ce05299a5 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.805718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ca6e-b638-425a-8879-dc2ce05299a5 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.806004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ca6e-b638-425a-8879-dc2ce05299a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.825022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f6d0ca6e-b638-425a-8879-dc2ce05299a5 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:26.826191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f6d0ca6e-b638-425a-8879-dc2ce05299a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:26.878733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:26.879759 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:26.890750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9d25-9f5d-4f9c-96df-6433b3c3685b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:26.926610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 399/771] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:26.958235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b5c38-9cc1-4f1c-96f9-8d1008ee204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:26.958980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b5c38-9cc1-4f1c-96f9-8d1008ee204a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:26.959274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b5c38-9cc1-4f1c-96f9-8d1008ee204a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:26.959579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b5c38-9cc1-4f1c-96f9-8d1008ee204a None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:26.960360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b5c38-9cc1-4f1c-96f9-8d1008ee204a None admin] RBAC: Adding query filter params (name=network) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:26.960678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b5c38-9cc1-4f1c-96f9-8d1008ee204a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:26.962132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b5c38-9cc1-4f1c-96f9-8d1008ee204a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:26.970154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0ca6e-b638-425a-8879-dc2ce05299a5 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.977803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 373/772] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:26.979044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b5c38-9cc1-4f1c-96f9-8d1008ee204a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:27.130641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0ca6e-b638-425a-8879-dc2ce05299a5 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.151865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b5c38-9cc1-4f1c-96f9-8d1008ee204a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.182579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61296f-3fa7-4a60-90ab-a61840a76ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.183791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61296f-3fa7-4a60-90ab-a61840a76ec0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.184337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61296f-3fa7-4a60-90ab-a61840a76ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.185481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61296f-3fa7-4a60-90ab-a61840a76ec0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.186351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61296f-3fa7-4a60-90ab-a61840a76ec0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.187945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61296f-3fa7-4a60-90ab-a61840a76ec0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-ce61296f-3fa7-4a60-90ab-a61840a76ec0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:27.205133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:27.206139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:43:27.206990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:27.210460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 400/773] 10.222.0.93 () {56 vars in 1129 bytes} [Thu May 26 16:43:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:27.216464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61296f-3fa7-4a60-90ab-a61840a76ec0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:27.225404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56579c8-c4a3-4827-bf62-d96007e7c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.226479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56579c8-c4a3-4827-bf62-d96007e7c845 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.227914 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56579c8-c4a3-4827-bf62-d96007e7c845 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.228397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56579c8-c4a3-4827-bf62-d96007e7c845 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.230735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56579c8-c4a3-4827-bf62-d96007e7c845 None admin] RBAC: Adding query filter params (type=network) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:27.231259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56579c8-c4a3-4827-bf62-d96007e7c845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.235543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56579c8-c4a3-4827-bf62-d96007e7c845 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.256179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 374/774] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:27.261819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56579c8-c4a3-4827-bf62-d96007e7c845 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:27.299792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:27.304554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:27.395180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61296f-3fa7-4a60-90ab-a61840a76ec0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.431908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d9c13-a57a-437c-90f6-714ba365d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.433042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d9c13-a57a-437c-90f6-714ba365d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.433527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d9c13-a57a-437c-90f6-714ba365d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.434071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d9c13-a57a-437c-90f6-714ba365d2f7 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.435046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d9c13-a57a-437c-90f6-714ba365d2f7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:27.435581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d9c13-a57a-437c-90f6-714ba365d2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.437761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d9c13-a57a-437c-90f6-714ba365d2f7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.443462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 401/775] 10.222.0.93 () {56 vars in 1124 bytes} [Thu May 26 16:43:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:27.456629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d9c13-a57a-437c-90f6-714ba365d2f7 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:27.504247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56579c8-c4a3-4827-bf62-d96007e7c845 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.563298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1960a0-bbd7-4baa-b7ec-2d1b31e068af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.563995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1960a0-bbd7-4baa-b7ec-2d1b31e068af None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.564330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1960a0-bbd7-4baa-b7ec-2d1b31e068af None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.564630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1960a0-bbd7-4baa-b7ec-2d1b31e068af None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.565455 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1960a0-bbd7-4baa-b7ec-2d1b31e068af None admin] RBAC: Adding query filter params (interface=public, service_id=098076996fc54ad79790ec278f0d4c14, region_id=RegionOne) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:27.565774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1960a0-bbd7-4baa-b7ec-2d1b31e068af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.567161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1960a0-bbd7-4baa-b7ec-2d1b31e068af None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.582766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 375/776] 10.222.0.93 () {56 vars in 1251 bytes} [Thu May 26 16:43:27 2022] GET /identity/v3/endpoints?service_id=098076996fc54ad79790ec278f0d4c14&interface=public®ion_id=RegionOne => generated 194 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:27.588600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1960a0-bbd7-4baa-b7ec-2d1b31e068af None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:27.650380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:27.663923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d9c13-a57a-437c-90f6-714ba365d2f7 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.742474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0792a-e8b1-4bbf-8459-ed4de99b15d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.743152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0792a-e8b1-4bbf-8459-ed4de99b15d8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.743432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0792a-e8b1-4bbf-8459-ed4de99b15d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.743727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0792a-e8b1-4bbf-8459-ed4de99b15d8 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.744433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0792a-e8b1-4bbf-8459-ed4de99b15d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:27.744735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0792a-e8b1-4bbf-8459-ed4de99b15d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.746092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0792a-e8b1-4bbf-8459-ed4de99b15d8 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.756072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 402/777] 10.222.0.93 () {56 vars in 1124 bytes} [Thu May 26 16:43:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:27.761877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0792a-e8b1-4bbf-8459-ed4de99b15d8 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:27.763965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:27.792870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1960a0-bbd7-4baa-b7ec-2d1b31e068af None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.862184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921517-e80b-4bad-8a0c-af9df8534fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.862865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921517-e80b-4bad-8a0c-af9df8534fa4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.863149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921517-e80b-4bad-8a0c-af9df8534fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.863426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921517-e80b-4bad-8a0c-af9df8534fa4 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.864144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921517-e80b-4bad-8a0c-af9df8534fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.865892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921517-e80b-4bad-8a0c-af9df8534fa4 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.880127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 376/778] 10.222.0.93 () {56 vars in 1087 bytes} [Thu May 26 16:43:27 2022] GET /identity/v3/services => generated 772 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:27.891686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0792a-e8b1-4bbf-8459-ed4de99b15d8 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.931784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d96cfc-cd87-4c3c-b189-491258e781ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.933152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96cfc-cd87-4c3c-b189-491258e781ba None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.933584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96cfc-cd87-4c3c-b189-491258e781ba None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.934005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96cfc-cd87-4c3c-b189-491258e781ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.934980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d96cfc-cd87-4c3c-b189-491258e781ba None admin] RBAC: Adding query filter params (interface=public, service_id=040ba4f1f3104449b3b44d3a70f4a1a3, region_id=RegionOne) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:27.935464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d96cfc-cd87-4c3c-b189-491258e781ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.937240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d96cfc-cd87-4c3c-b189-491258e781ba None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.948175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 403/779] 10.222.0.93 () {56 vars in 1251 bytes} [Thu May 26 16:43:27 2022] GET /identity/v3/endpoints?service_id=040ba4f1f3104449b3b44d3a70f4a1a3&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:27.954581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921517-e80b-4bad-8a0c-af9df8534fa4 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:28.128440 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921517-e80b-4bad-8a0c-af9df8534fa4 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.184981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37cc92-c94d-4e89-9473-13fdfd0e1746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.186003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37cc92-c94d-4e89-9473-13fdfd0e1746 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.186471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37cc92-c94d-4e89-9473-13fdfd0e1746 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.186933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37cc92-c94d-4e89-9473-13fdfd0e1746 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.187866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37cc92-c94d-4e89-9473-13fdfd0e1746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:28.189568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37cc92-c94d-4e89-9473-13fdfd0e1746 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:28.198421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 377/780] 10.222.0.93 () {56 vars in 1087 bytes} [Thu May 26 16:43:27 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:28.614276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00ca46-77af-4f85-ab50-152281d5fd18 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.614826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00ca46-77af-4f85-ab50-152281d5fd18 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.615108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00ca46-77af-4f85-ab50-152281d5fd18 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.616668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 404/781] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:28.623219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c0f6c-2a2b-40b3-ae82-2344028387e9 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.624148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c0f6c-2a2b-40b3-ae82-2344028387e9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.624625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c0f6c-2a2b-40b3-ae82-2344028387e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.641936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5c9c0f6c-2a2b-40b3-ae82-2344028387e9 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:28.643453 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5c9c0f6c-2a2b-40b3-ae82-2344028387e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:28.646805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:28.753917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 378/782] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:28.778658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00ca46-77af-4f85-ab50-152281d5fd18 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:28.810699 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:28.892894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00ca46-77af-4f85-ab50-152281d5fd18 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.931945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e32302-bdbb-4ecb-94f0-9e9b01454266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.932733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e32302-bdbb-4ecb-94f0-9e9b01454266 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.933050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e32302-bdbb-4ecb-94f0-9e9b01454266 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.933382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e32302-bdbb-4ecb-94f0-9e9b01454266 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.945954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e32302-bdbb-4ecb-94f0-9e9b01454266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-82e32302-bdbb-4ecb-94f0-9e9b01454266 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:28.954117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:28.955116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:28.956018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 405/783] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:28.962110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c0f6c-2a2b-40b3-ae82-2344028387e9 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.104572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c0f6c-2a2b-40b3-ae82-2344028387e9 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.158377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c891a3-e8c8-4e4c-be3f-60563c4a39d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.159456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c891a3-e8c8-4e4c-be3f-60563c4a39d6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.159996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c891a3-e8c8-4e4c-be3f-60563c4a39d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.160482 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c891a3-e8c8-4e4c-be3f-60563c4a39d6 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.161508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c891a3-e8c8-4e4c-be3f-60563c4a39d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:29.162036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c891a3-e8c8-4e4c-be3f-60563c4a39d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.163757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c891a3-e8c8-4e4c-be3f-60563c4a39d6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.179323 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 379/784] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:29.185789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e32302-bdbb-4ecb-94f0-9e9b01454266 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.300877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:29.313845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e32302-bdbb-4ecb-94f0-9e9b01454266 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.351480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77bdff-f549-4459-918e-42b106b5cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.352342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77bdff-f549-4459-918e-42b106b5cb43 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.352628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77bdff-f549-4459-918e-42b106b5cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.352909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77bdff-f549-4459-918e-42b106b5cb43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.367261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77bdff-f549-4459-918e-42b106b5cb43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.368763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77bdff-f549-4459-918e-42b106b5cb43 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-ac77bdff-f549-4459-918e-42b106b5cb43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:29.397439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:29.399067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:29.400552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:29.400552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:29.400552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:29.400552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:29.401583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 406/785] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:29.407400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c891a3-e8c8-4e4c-be3f-60563c4a39d6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.410498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:29.544316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c891a3-e8c8-4e4c-be3f-60563c4a39d6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.589447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2367a9-f3ba-4ec8-8a8e-bf777db83f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.590108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2367a9-f3ba-4ec8-8a8e-bf777db83f1d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.590413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2367a9-f3ba-4ec8-8a8e-bf777db83f1d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.590709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2367a9-f3ba-4ec8-8a8e-bf777db83f1d None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.591499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2367a9-f3ba-4ec8-8a8e-bf777db83f1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:29.592092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2367a9-f3ba-4ec8-8a8e-bf777db83f1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.593522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2367a9-f3ba-4ec8-8a8e-bf777db83f1d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.608151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 380/786] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:29.614052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77bdff-f549-4459-918e-42b106b5cb43 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.658367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d110e9-b7e0-4ec0-9796-40549da56b86 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.658886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d110e9-b7e0-4ec0-9796-40549da56b86 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.658998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d110e9-b7e0-4ec0-9796-40549da56b86 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.660954 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 381/787] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:29.669150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07bb14-9104-43b8-a196-ff0fec42c5b8 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.669659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07bb14-9104-43b8-a196-ff0fec42c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.670151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07bb14-9104-43b8-a196-ff0fec42c5b8 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.672010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 382/788] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:29.673425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9760e-4f07-47fd-86d8-612b6956d598 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.673929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9760e-4f07-47fd-86d8-612b6956d598 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.674418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9760e-4f07-47fd-86d8-612b6956d598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.696986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-93d9760e-4f07-47fd-86d8-612b6956d598 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:29.698271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-93d9760e-4f07-47fd-86d8-612b6956d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:29.744833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77bdff-f549-4459-918e-42b106b5cb43 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.767034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:29.781563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 383/789] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:29.783353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc480562-1b55-4787-92e7-7ceb55068c93 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.783666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc480562-1b55-4787-92e7-7ceb55068c93 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.787673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc480562-1b55-4787-92e7-7ceb55068c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.807588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-fc480562-1b55-4787-92e7-7ceb55068c93 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:29.807785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafd203-c787-4f9a-adb7-9f0180595d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.807885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fc480562-1b55-4787-92e7-7ceb55068c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:29.807991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafd203-c787-4f9a-adb7-9f0180595d32 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.808071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafd203-c787-4f9a-adb7-9f0180595d32 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.808327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafd203-c787-4f9a-adb7-9f0180595d32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.818420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafd203-c787-4f9a-adb7-9f0180595d32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.820274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafd203-c787-4f9a-adb7-9f0180595d32 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-0eafd203-c787-4f9a-adb7-9f0180595d32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:29.842099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:29.843146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:29.844164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 407/790] 10.222.0.93 () {56 vars in 1093 bytes} [Thu May 26 16:43:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:29.844845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafd203-c787-4f9a-adb7-9f0180595d32 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.850390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:29.885429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 384/791] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:29.886754 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc480562-1b55-4787-92e7-7ceb55068c93 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.959492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafd203-c787-4f9a-adb7-9f0180595d32 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.996423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a88b-3133-4697-a6bf-e2d0cdc17a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.998009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a88b-3133-4697-a6bf-e2d0cdc17a96 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.998562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a88b-3133-4697-a6bf-e2d0cdc17a96 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.998977 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a88b-3133-4697-a6bf-e2d0cdc17a96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.002543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc480562-1b55-4787-92e7-7ceb55068c93 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.011195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88a88b-3133-4697-a6bf-e2d0cdc17a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-fa88a88b-3133-4697-a6bf-e2d0cdc17a96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:30.020878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:30.021963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:30.022850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:30.025695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 408/792] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:30.026819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a88b-3133-4697-a6bf-e2d0cdc17a96 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.029572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.042887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144372ba-c955-4f20-b299-999a78b71268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.043689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144372ba-c955-4f20-b299-999a78b71268 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.044119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144372ba-c955-4f20-b299-999a78b71268 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.044467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144372ba-c955-4f20-b299-999a78b71268 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.045486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144372ba-c955-4f20-b299-999a78b71268 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:30.045969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144372ba-c955-4f20-b299-999a78b71268 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.047497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144372ba-c955-4f20-b299-999a78b71268 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.073937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 385/793] 10.222.0.93 () {56 vars in 1133 bytes} [Thu May 26 16:43:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:30.075143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144372ba-c955-4f20-b299-999a78b71268 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.101091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.160679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a88b-3133-4697-a6bf-e2d0cdc17a96 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.194065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144372ba-c955-4f20-b299-999a78b71268 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.205885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028cbea-2476-4553-b767-ff65eb60920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.207159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028cbea-2476-4553-b767-ff65eb60920b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.207582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028cbea-2476-4553-b767-ff65eb60920b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.207878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028cbea-2476-4553-b767-ff65eb60920b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.222621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028cbea-2476-4553-b767-ff65eb60920b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-2028cbea-2476-4553-b767-ff65eb60920b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:30.235071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:30.236226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:30.237099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 409/794] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:30.237801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028cbea-2476-4553-b767-ff65eb60920b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.242511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d59efb-df1e-4878-99fe-f8036d2d8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.243116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d59efb-df1e-4878-99fe-f8036d2d8d5a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.243414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d59efb-df1e-4878-99fe-f8036d2d8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.243727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d59efb-df1e-4878-99fe-f8036d2d8d5a None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.244517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d59efb-df1e-4878-99fe-f8036d2d8d5a None admin] RBAC: Adding query filter params (name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:30.244833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d59efb-df1e-4878-99fe-f8036d2d8d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.246344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d59efb-df1e-4878-99fe-f8036d2d8d5a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.265183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 386/795] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:30.266279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d59efb-df1e-4878-99fe-f8036d2d8d5a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.324586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.379456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028cbea-2476-4553-b767-ff65eb60920b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.389093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d59efb-df1e-4878-99fe-f8036d2d8d5a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.403021 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.421822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80b544-4dee-46f4-a90a-918384bbee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.422793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80b544-4dee-46f4-a90a-918384bbee42 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.423253 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80b544-4dee-46f4-a90a-918384bbee42 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.423723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80b544-4dee-46f4-a90a-918384bbee42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.427524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faab75b-2e12-4b02-b4c1-d35055493287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.428241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faab75b-2e12-4b02-b4c1-d35055493287 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.428838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faab75b-2e12-4b02-b4c1-d35055493287 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.428838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faab75b-2e12-4b02-b4c1-d35055493287 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.429529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faab75b-2e12-4b02-b4c1-d35055493287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:30.429839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faab75b-2e12-4b02-b4c1-d35055493287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.431230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faab75b-2e12-4b02-b4c1-d35055493287 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.445891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 387/796] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:30.446922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faab75b-2e12-4b02-b4c1-d35055493287 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.507042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80b544-4dee-46f4-a90a-918384bbee42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.509018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80b544-4dee-46f4-a90a-918384bbee42 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.557545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faab75b-2e12-4b02-b4c1-d35055493287 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.560122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.594917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf56b85-7a1e-4784-82fc-b81db5ae1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.595757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56b85-7a1e-4784-82fc-b81db5ae1713 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.596050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56b85-7a1e-4784-82fc-b81db5ae1713 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.596316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56b85-7a1e-4784-82fc-b81db5ae1713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.609228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf56b85-7a1e-4784-82fc-b81db5ae1713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.610887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf56b85-7a1e-4784-82fc-b81db5ae1713 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-baf56b85-7a1e-4784-82fc-b81db5ae1713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:30.633314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:30.634298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:30.635221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:30.635221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:30.635221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:30.635221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:30.635811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 388/798] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:30.636005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 410/798] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:43:30.636729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf56b85-7a1e-4784-82fc-b81db5ae1713 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.640942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80b544-4dee-46f4-a90a-918384bbee42 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.668380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.748519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf56b85-7a1e-4784-82fc-b81db5ae1713 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.767771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80b544-4dee-46f4-a90a-918384bbee42 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.787671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5942e-2e01-433c-a807-b0af593467aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.788580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5942e-2e01-433c-a807-b0af593467aa None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.788870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5942e-2e01-433c-a807-b0af593467aa None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.789148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5942e-2e01-433c-a807-b0af593467aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.802779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5942e-2e01-433c-a807-b0af593467aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.804405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5942e-2e01-433c-a807-b0af593467aa None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.809520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a55a37-9e3c-47d9-ab56-2e4e2f2f2ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.810590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a55a37-9e3c-47d9-ab56-2e4e2f2f2ee9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.811049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a55a37-9e3c-47d9-ab56-2e4e2f2f2ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.811516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a55a37-9e3c-47d9-ab56-2e4e2f2f2ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.823717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a55a37-9e3c-47d9-ab56-2e4e2f2f2ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.826086 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a55a37-9e3c-47d9-ab56-2e4e2f2f2ee9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-50c5942e-2e01-433c-a807-b0af593467aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:30.826659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:30.827538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:30.828555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:30.828555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:30.828555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:30.828555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:30.831644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 389/799] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:30.832819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5942e-2e01-433c-a807-b0af593467aa None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.848853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-15a55a37-9e3c-47d9-ab56-2e4e2f2f2ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:30.853452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:30.854367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:30.864114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:30.864114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:30.864114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:30.864114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:30.864114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 411/800] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:30.864114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a55a37-9e3c-47d9-ab56-2e4e2f2f2ee9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:30.937796 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.956578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5942e-2e01-433c-a807-b0af593467aa None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.973313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a55a37-9e3c-47d9-ab56-2e4e2f2f2ee9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.996649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055a9d1-6a68-4e32-ac1d-4d217a31b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.997339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a9d1-6a68-4e32-ac1d-4d217a31b141 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.997634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a9d1-6a68-4e32-ac1d-4d217a31b141 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.997910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a9d1-6a68-4e32-ac1d-4d217a31b141 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.998648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055a9d1-6a68-4e32-ac1d-4d217a31b141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:30.998957 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055a9d1-6a68-4e32-ac1d-4d217a31b141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.000524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055a9d1-6a68-4e32-ac1d-4d217a31b141 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.011289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bcba7-98e7-4bac-ab72-d3342804fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.012048 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bcba7-98e7-4bac-ab72-d3342804fe96 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.012355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bcba7-98e7-4bac-ab72-d3342804fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.013156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bcba7-98e7-4bac-ab72-d3342804fe96 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.013915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bcba7-98e7-4bac-ab72-d3342804fe96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:31.014219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bcba7-98e7-4bac-ab72-d3342804fe96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.015670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bcba7-98e7-4bac-ab72-d3342804fe96 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.019501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 390/801] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:31.021105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ef388-dd54-44ec-a6f0-5a87965ea8f6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.021448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ef388-dd54-44ec-a6f0-5a87965ea8f6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.021984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ef388-dd54-44ec-a6f0-5a87965ea8f6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.023400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 391/802] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:31.024148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ef388-dd54-44ec-a6f0-5a87965ea8f6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.033411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 412/803] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:31.034205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bcba7-98e7-4bac-ab72-d3342804fe96 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.105919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:31.143089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ef388-dd54-44ec-a6f0-5a87965ea8f6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:31.154502 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bcba7-98e7-4bac-ab72-d3342804fe96 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:31.183676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b476827-38c3-41d1-8c06-624afeca9c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.187082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b476827-38c3-41d1-8c06-624afeca9c8e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.187082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b476827-38c3-41d1-8c06-624afeca9c8e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.187082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b476827-38c3-41d1-8c06-624afeca9c8e None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.187082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b476827-38c3-41d1-8c06-624afeca9c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:31.187082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b476827-38c3-41d1-8c06-624afeca9c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.188199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b476827-38c3-41d1-8c06-624afeca9c8e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.188610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:31.194555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdf607-1570-446f-af8b-4a60d2404a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.195370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdf607-1570-446f-af8b-4a60d2404a04 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.195810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdf607-1570-446f-af8b-4a60d2404a04 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.196214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdf607-1570-446f-af8b-4a60d2404a04 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.207078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 392/804] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:31.207078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c93545-b10f-4204-b53b-14bc66973bfc None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.207078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c93545-b10f-4204-b53b-14bc66973bfc None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.207078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c93545-b10f-4204-b53b-14bc66973bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.208705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdf607-1570-446f-af8b-4a60d2404a04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.212528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdf607-1570-446f-af8b-4a60d2404a04 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.221760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-53c93545-b10f-4204-b53b-14bc66973bfc None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:31.223016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-53c93545-b10f-4204-b53b-14bc66973bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-dafdf607-1570-446f-af8b-4a60d2404a04 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:31.226465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:31.228337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 413/805] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:31.229364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdf607-1570-446f-af8b-4a60d2404a04 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.291640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 393/806] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:31.292963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17030c-65cf-4446-8a2c-78ecca42263c None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.293271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17030c-65cf-4446-8a2c-78ecca42263c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.293548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17030c-65cf-4446-8a2c-78ecca42263c None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.299638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 394/807] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:31.299638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17030c-65cf-4446-8a2c-78ecca42263c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.355061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdf607-1570-446f-af8b-4a60d2404a04 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:31.363582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:31.389562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddcfc2-375d-47ba-ad2d-443f0168f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.390346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddcfc2-375d-47ba-ad2d-443f0168f204 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.390625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddcfc2-375d-47ba-ad2d-443f0168f204 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.390898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddcfc2-375d-47ba-ad2d-443f0168f204 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.398541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddcfc2-375d-47ba-ad2d-443f0168f204 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.400087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddcfc2-375d-47ba-ad2d-443f0168f204 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.406711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17030c-65cf-4446-8a2c-78ecca42263c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-56ddcfc2-375d-47ba-ad2d-443f0168f204 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:31.414189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:31.415277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 414/808] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:31.416289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddcfc2-375d-47ba-ad2d-443f0168f204 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.444244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859ec18-4b39-414d-86fb-4302b38eb23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.445027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859ec18-4b39-414d-86fb-4302b38eb23b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.445308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859ec18-4b39-414d-86fb-4302b38eb23b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.445584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859ec18-4b39-414d-86fb-4302b38eb23b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.453179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859ec18-4b39-414d-86fb-4302b38eb23b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.454632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859ec18-4b39-414d-86fb-4302b38eb23b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-7859ec18-4b39-414d-86fb-4302b38eb23b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:31.469169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:31.470091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:31.471102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:31.471102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:31.471102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:31.471102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:31.471102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:31.471102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:31.471102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:31.471102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:31.471102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 395/809] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:31.471625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94e40-76a0-4124-9779-7a57af9e7d67 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.472550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94e40-76a0-4124-9779-7a57af9e7d67 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.472550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94e40-76a0-4124-9779-7a57af9e7d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.475748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:31.488968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e3f94e40-76a0-4124-9779-7a57af9e7d67 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:31.490166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e3f94e40-76a0-4124-9779-7a57af9e7d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:31.525946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddcfc2-375d-47ba-ad2d-443f0168f204 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:31.562856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eff0c5-01c4-4ad8-bc24-0b900b0aadca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.563456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff0c5-01c4-4ad8-bc24-0b900b0aadca None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.563745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff0c5-01c4-4ad8-bc24-0b900b0aadca None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.564044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff0c5-01c4-4ad8-bc24-0b900b0aadca None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.564878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eff0c5-01c4-4ad8-bc24-0b900b0aadca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:31.565182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eff0c5-01c4-4ad8-bc24-0b900b0aadca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.565453 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 396/810] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:31.566222 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f94e40-76a0-4124-9779-7a57af9e7d67 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.566609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eff0c5-01c4-4ad8-bc24-0b900b0aadca None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.593820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 415/811] 10.222.0.93 () {56 vars in 1149 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:31.594977 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eff0c5-01c4-4ad8-bc24-0b900b0aadca None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.623385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:31.675146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f94e40-76a0-4124-9779-7a57af9e7d67 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:31.697713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eff0c5-01c4-4ad8-bc24-0b900b0aadca None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:31.709146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:31.712619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213afec-553e-4f2d-b942-66db81b4dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.713585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213afec-553e-4f2d-b942-66db81b4dfef None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.713865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213afec-553e-4f2d-b942-66db81b4dfef None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.714139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213afec-553e-4f2d-b942-66db81b4dfef None admin] PATH_INFO: `/v3/services/network` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.714787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213afec-553e-4f2d-b942-66db81b4dfef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.716190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213afec-553e-4f2d-b942-66db81b4dfef None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-1213afec-553e-4f2d-b942-66db81b4dfef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:31.728113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:31.729121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:31.730024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 397/812] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:31.730845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213afec-553e-4f2d-b942-66db81b4dfef None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.742023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e261cd-2b54-4a25-aaf6-39409db003bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.742682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e261cd-2b54-4a25-aaf6-39409db003bc None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.742959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e261cd-2b54-4a25-aaf6-39409db003bc None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.743229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e261cd-2b54-4a25-aaf6-39409db003bc None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.744107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e261cd-2b54-4a25-aaf6-39409db003bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:31.744402 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e261cd-2b54-4a25-aaf6-39409db003bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.745843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e261cd-2b54-4a25-aaf6-39409db003bc None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.765096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 416/813] 10.222.0.93 () {56 vars in 1135 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:31.766150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e261cd-2b54-4a25-aaf6-39409db003bc None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.848157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213afec-553e-4f2d-b942-66db81b4dfef None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:31.857523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:31.865855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e261cd-2b54-4a25-aaf6-39409db003bc None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:31.880710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94ae96-07f4-42c2-bd87-2ccef7a72877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.881367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94ae96-07f4-42c2-bd87-2ccef7a72877 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.881653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94ae96-07f4-42c2-bd87-2ccef7a72877 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.881934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94ae96-07f4-42c2-bd87-2ccef7a72877 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.882711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94ae96-07f4-42c2-bd87-2ccef7a72877 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:31.883017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94ae96-07f4-42c2-bd87-2ccef7a72877 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.885386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94ae96-07f4-42c2-bd87-2ccef7a72877 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.897040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 398/814] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:31.897880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94ae96-07f4-42c2-bd87-2ccef7a72877 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.907126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a1c2c-b611-42b2-a3f7-f16464c9aa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:31.908198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a1c2c-b611-42b2-a3f7-f16464c9aa77 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:31.908573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a1c2c-b611-42b2-a3f7-f16464c9aa77 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:31.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a1c2c-b611-42b2-a3f7-f16464c9aa77 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:31.909780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a1c2c-b611-42b2-a3f7-f16464c9aa77 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:31.911585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a1c2c-b611-42b2-a3f7-f16464c9aa77 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-5a7a1c2c-b611-42b2-a3f7-f16464c9aa77 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:31.928262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:31.929450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:31.930427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 417/815] 10.222.0.93 () {56 vars in 1129 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:31.931428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a1c2c-b611-42b2-a3f7-f16464c9aa77 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:31.963852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.005729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94ae96-07f4-42c2-bd87-2ccef7a72877 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.031992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a1c2c-b611-42b2-a3f7-f16464c9aa77 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.038850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a203ac-b847-47b1-8982-7fc45b4e2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.039677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a203ac-b847-47b1-8982-7fc45b4e2437 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.039961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a203ac-b847-47b1-8982-7fc45b4e2437 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.040236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a203ac-b847-47b1-8982-7fc45b4e2437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.050919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a203ac-b847-47b1-8982-7fc45b4e2437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.052403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a203ac-b847-47b1-8982-7fc45b4e2437 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.065864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047eb05-3ff7-4d40-89fd-5ef586747363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.066520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047eb05-3ff7-4d40-89fd-5ef586747363 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.066827 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047eb05-3ff7-4d40-89fd-5ef586747363 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.067078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047eb05-3ff7-4d40-89fd-5ef586747363 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.067804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047eb05-3ff7-4d40-89fd-5ef586747363 None admin] RBAC: Adding query filter params (name=network) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:32.068106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047eb05-3ff7-4d40-89fd-5ef586747363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.069476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047eb05-3ff7-4d40-89fd-5ef586747363 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-f6a203ac-b847-47b1-8982-7fc45b4e2437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:32.070579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:32.071550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:32.072696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:32.072696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:32.072696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:32.072696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:32.072696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 399/816] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:32.073039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a203ac-b847-47b1-8982-7fc45b4e2437 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.079388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 418/817] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:32.080263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047eb05-3ff7-4d40-89fd-5ef586747363 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.100925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.174318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a203ac-b847-47b1-8982-7fc45b4e2437 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.178937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.185033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047eb05-3ff7-4d40-89fd-5ef586747363 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.208565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1d2f6-17da-42d1-82b9-f2e265c9c4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.209376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1d2f6-17da-42d1-82b9-f2e265c9c4c6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.209658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1d2f6-17da-42d1-82b9-f2e265c9c4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.209926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1d2f6-17da-42d1-82b9-f2e265c9c4c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.220521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf45de-266a-4ff9-b7ad-ad1d5e69b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.220811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1d2f6-17da-42d1-82b9-f2e265c9c4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.221174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf45de-266a-4ff9-b7ad-ad1d5e69b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.221457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf45de-266a-4ff9-b7ad-ad1d5e69b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.221733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf45de-266a-4ff9-b7ad-ad1d5e69b3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.222230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1d2f6-17da-42d1-82b9-f2e265c9c4c6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.222562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf45de-266a-4ff9-b7ad-ad1d5e69b3b4 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=8dd8a5a74a2947e385ca0cb7f3ee6428) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:32.222878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf45de-266a-4ff9-b7ad-ad1d5e69b3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.224343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf45de-266a-4ff9-b7ad-ad1d5e69b3b4 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.230197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 419/818] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/role_assignments?user.id=8dd8a5a74a2947e385ca0cb7f3ee6428&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:32.230978 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf45de-266a-4ff9-b7ad-ad1d5e69b3b4 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-4ae1d2f6-17da-42d1-82b9-f2e265c9c4c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:32.250417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:32.251634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:32.252576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:32.252576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:32.252576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:32.252576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:32.252576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 400/819] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:32.252576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1d2f6-17da-42d1-82b9-f2e265c9c4c6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.344893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.374588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf45de-266a-4ff9-b7ad-ad1d5e69b3b4 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.374787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1d2f6-17da-42d1-82b9-f2e265c9c4c6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.393446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef907ba-ff38-417b-bf1a-8cd47d293087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.394129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef907ba-ff38-417b-bf1a-8cd47d293087 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.394408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef907ba-ff38-417b-bf1a-8cd47d293087 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.394684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef907ba-ff38-417b-bf1a-8cd47d293087 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.395407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef907ba-ff38-417b-bf1a-8cd47d293087 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:32.395748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef907ba-ff38-417b-bf1a-8cd47d293087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.397160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef907ba-ff38-417b-bf1a-8cd47d293087 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.408109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 420/820] 10.222.0.93 () {56 vars in 1124 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:32.408109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef907ba-ff38-417b-bf1a-8cd47d293087 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.418775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53c74-8bc8-455a-922f-cd0c24a4d18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.420083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53c74-8bc8-455a-922f-cd0c24a4d18a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.420083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53c74-8bc8-455a-922f-cd0c24a4d18a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.420313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53c74-8bc8-455a-922f-cd0c24a4d18a None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.421030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53c74-8bc8-455a-922f-cd0c24a4d18a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:32.421676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53c74-8bc8-455a-922f-cd0c24a4d18a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.423271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53c74-8bc8-455a-922f-cd0c24a4d18a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.437936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.438815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 401/821] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:32.439737 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53c74-8bc8-455a-922f-cd0c24a4d18a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.516817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef907ba-ff38-417b-bf1a-8cd47d293087 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.552218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53c74-8bc8-455a-922f-cd0c24a4d18a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.552677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913e143-04dd-4a92-bc66-2e83c5ccff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.553531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e143-04dd-4a92-bc66-2e83c5ccff52 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.553954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e143-04dd-4a92-bc66-2e83c5ccff52 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.554374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e143-04dd-4a92-bc66-2e83c5ccff52 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.555222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913e143-04dd-4a92-bc66-2e83c5ccff52 None admin] RBAC: Adding query filter params (type=network) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:32.555535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913e143-04dd-4a92-bc66-2e83c5ccff52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.556927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913e143-04dd-4a92-bc66-2e83c5ccff52 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.566520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 421/822] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:32.566520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913e143-04dd-4a92-bc66-2e83c5ccff52 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.594550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfcfa5-58d0-4b5f-bd9a-dae978db631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.595318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcfa5-58d0-4b5f-bd9a-dae978db631b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.595705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcfa5-58d0-4b5f-bd9a-dae978db631b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.596060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcfa5-58d0-4b5f-bd9a-dae978db631b None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.596872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfcfa5-58d0-4b5f-bd9a-dae978db631b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:32.597265 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfcfa5-58d0-4b5f-bd9a-dae978db631b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.598709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfcfa5-58d0-4b5f-bd9a-dae978db631b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.601462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.612366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 402/823] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:32.613211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfcfa5-58d0-4b5f-bd9a-dae978db631b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.673190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.691698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913e143-04dd-4a92-bc66-2e83c5ccff52 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.728957 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfcfa5-58d0-4b5f-bd9a-dae978db631b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.730317 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f2c99-f12c-469e-992b-9122af47989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.731164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f2c99-f12c-469e-992b-9122af47989a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.732332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f2c99-f12c-469e-992b-9122af47989a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.732615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f2c99-f12c-469e-992b-9122af47989a None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.733335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f2c99-f12c-469e-992b-9122af47989a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:32.733640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f2c99-f12c-469e-992b-9122af47989a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.735014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f2c99-f12c-469e-992b-9122af47989a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.744571 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 422/824] 10.222.0.93 () {56 vars in 1124 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:32.745411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f2c99-f12c-469e-992b-9122af47989a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.778176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f402-c658-4259-823b-8ba1cd100d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.779339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f402-c658-4259-823b-8ba1cd100d99 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.779847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f402-c658-4259-823b-8ba1cd100d99 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.780298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f402-c658-4259-823b-8ba1cd100d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.788714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123f402-c658-4259-823b-8ba1cd100d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.790618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123f402-c658-4259-823b-8ba1cd100d99 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-0123f402-c658-4259-823b-8ba1cd100d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:32.806119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:32.807272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:32.808277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:32.808277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:32.808277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:32.808277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:32.808277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:32.808277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:32.808277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:32.808277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:32.808277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 403/825] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:32.808785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f402-c658-4259-823b-8ba1cd100d99 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:32.868959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f2c99-f12c-469e-992b-9122af47989a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.881721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:32.916642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfcacf-e85e-4d64-bdbc-ef3dc0b019a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.922682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfcacf-e85e-4d64-bdbc-ef3dc0b019a3 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.922682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfcacf-e85e-4d64-bdbc-ef3dc0b019a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.922682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfcacf-e85e-4d64-bdbc-ef3dc0b019a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.922682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfcacf-e85e-4d64-bdbc-ef3dc0b019a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.922682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfcacf-e85e-4d64-bdbc-ef3dc0b019a3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.927842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f402-c658-4259-823b-8ba1cd100d99 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:32.965398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8c3de-d3c3-430b-bf71-e072b689ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:32.966180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8c3de-d3c3-430b-bf71-e072b689ce52 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:32.966462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8c3de-d3c3-430b-bf71-e072b689ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:32.966997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8c3de-d3c3-430b-bf71-e072b689ce52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:32.974095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8c3de-d3c3-430b-bf71-e072b689ce52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:32.975767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8c3de-d3c3-430b-bf71-e072b689ce52 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-10c8c3de-d3c3-430b-bf71-e072b689ce52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:32.989696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:32.990761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 404/826] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:32.991909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8c3de-d3c3-430b-bf71-e072b689ce52 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:33.103972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8c3de-d3c3-430b-bf71-e072b689ce52 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:33.121036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:33.140902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed282a-2d6e-4f81-94a4-ed9529c354cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:33.141580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed282a-2d6e-4f81-94a4-ed9529c354cf None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:33.141865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed282a-2d6e-4f81-94a4-ed9529c354cf None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:33.142141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed282a-2d6e-4f81-94a4-ed9529c354cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:33.151427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed282a-2d6e-4f81-94a4-ed9529c354cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:33.151427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed282a-2d6e-4f81-94a4-ed9529c354cf None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:33.195829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 423/827] 10.222.0.93 () {60 vars in 1144 bytes} [Thu May 26 16:43:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:33.196791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfcacf-e85e-4d64-bdbc-ef3dc0b019a3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:33.217361 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:33.345933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfcacf-e85e-4d64-bdbc-ef3dc0b019a3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:33.388307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285dd3e-9802-45fe-b5ce-9b8c0ed5bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:33.388999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285dd3e-9802-45fe-b5ce-9b8c0ed5bb6e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:33.389283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285dd3e-9802-45fe-b5ce-9b8c0ed5bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:33.389561 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285dd3e-9802-45fe-b5ce-9b8c0ed5bb6e None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:33.390372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285dd3e-9802-45fe-b5ce-9b8c0ed5bb6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:33.390689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285dd3e-9802-45fe-b5ce-9b8c0ed5bb6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:33.392215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285dd3e-9802-45fe-b5ce-9b8c0ed5bb6e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:33.410188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 424/828] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:33.410188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285dd3e-9802-45fe-b5ce-9b8c0ed5bb6e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:33.464195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 405/829] 10.222.0.93 () {60 vars in 1144 bytes} [Thu May 26 16:43:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:33.465297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed282a-2d6e-4f81-94a4-ed9529c354cf None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:33.576128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285dd3e-9802-45fe-b5ce-9b8c0ed5bb6e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:33.629660 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fecf0-a97d-4f02-9822-c02890b5d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:33.630460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fecf0-a97d-4f02-9822-c02890b5d8ce None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:33.630916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fecf0-a97d-4f02-9822-c02890b5d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:33.631336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fecf0-a97d-4f02-9822-c02890b5d8ce None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:33.632518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fecf0-a97d-4f02-9822-c02890b5d8ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:33.632946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fecf0-a97d-4f02-9822-c02890b5d8ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:33.635260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fecf0-a97d-4f02-9822-c02890b5d8ce None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:33.644809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:33.661016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 425/830] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:33.661757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed282a-2d6e-4f81-94a4-ed9529c354cf None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:33.670128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fecf0-a97d-4f02-9822-c02890b5d8ce None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:33.716635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749053-b1e5-471e-9383-8025d2098c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:33.718378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749053-b1e5-471e-9383-8025d2098c80 None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:33.719833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749053-b1e5-471e-9383-8025d2098c80 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:33.720312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749053-b1e5-471e-9383-8025d2098c80 None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/58fb392b863c48cb9c6ae5c209e9cac3/roles/a13a3c6af2864ff1848ccbb2da56273e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:33.744057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749053-b1e5-471e-9383-8025d2098c80 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=58fb392b863c48cb9c6ae5c209e9cac3, role_id=a13a3c6af2864ff1848ccbb2da56273e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:33.745592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749053-b1e5-471e-9383-8025d2098c80 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:33.801245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fecf0-a97d-4f02-9822-c02890b5d8ce None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:33.828044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:33.844832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa5a1b-5430-4cb8-8b44-601c50e69b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:33.846232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa5a1b-5430-4cb8-8b44-601c50e69b60 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:33.846562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa5a1b-5430-4cb8-8b44-601c50e69b60 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:33.846835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa5a1b-5430-4cb8-8b44-601c50e69b60 None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/45cfc967b8634e60b3ddfe4168a748b4/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:33.848894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa5a1b-5430-4cb8-8b44-601c50e69b60 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=45cfc967b8634e60b3ddfe4168a748b4, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:33.850542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa5a1b-5430-4cb8-8b44-601c50e69b60 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:33.896505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 406/831] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:43:33 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/58fb392b863c48cb9c6ae5c209e9cac3/roles/a13a3c6af2864ff1848ccbb2da56273e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:34.084221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 426/832] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:43:33 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/45cfc967b8634e60b3ddfe4168a748b4/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:34.627124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178dc42-c6be-4674-a74e-42620cfe3a3e None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.627435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178dc42-c6be-4674-a74e-42620cfe3a3e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.627733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178dc42-c6be-4674-a74e-42620cfe3a3e None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.629365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 407/833] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:34.635003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c1635-d46c-463d-9504-511bc80403fb None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.635496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c1635-d46c-463d-9504-511bc80403fb None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.635618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c1635-d46c-463d-9504-511bc80403fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.654099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-fb8c1635-d46c-463d-9504-511bc80403fb None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:34.655274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-fb8c1635-d46c-463d-9504-511bc80403fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:34.731644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 427/834] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:34.748399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178dc42-c6be-4674-a74e-42620cfe3a3e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:34.775032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:34.862304 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178dc42-c6be-4674-a74e-42620cfe3a3e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:34.898819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28097773-3972-4f51-9dd3-0f5f797a4025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:34.899582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28097773-3972-4f51-9dd3-0f5f797a4025 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:34.899872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28097773-3972-4f51-9dd3-0f5f797a4025 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:34.900149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28097773-3972-4f51-9dd3-0f5f797a4025 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:34.900850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28097773-3972-4f51-9dd3-0f5f797a4025 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:34.902235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28097773-3972-4f51-9dd3-0f5f797a4025 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-28097773-3972-4f51-9dd3-0f5f797a4025 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:34.916110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:34.917296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:43:34.918241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:34.922586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 408/835] 10.222.0.93 () {56 vars in 1132 bytes} [Thu May 26 16:43:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:34.924044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c1635-d46c-463d-9504-511bc80403fb None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.037616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c1635-d46c-463d-9504-511bc80403fb None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.050215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:35.083879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6b93a-b512-4a55-a596-55dcaa671a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.084602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6b93a-b512-4a55-a596-55dcaa671a82 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.084889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6b93a-b512-4a55-a596-55dcaa671a82 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.085157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6b93a-b512-4a55-a596-55dcaa671a82 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.085863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6b93a-b512-4a55-a596-55dcaa671a82 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:35.086165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6b93a-b512-4a55-a596-55dcaa671a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.087526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6b93a-b512-4a55-a596-55dcaa671a82 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.093266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 428/836] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:35.101792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28097773-3972-4f51-9dd3-0f5f797a4025 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:35.201284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:35.220615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28097773-3972-4f51-9dd3-0f5f797a4025 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:35.257741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23660cc9-2642-4002-81dc-8360d405df60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:35.258411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660cc9-2642-4002-81dc-8360d405df60 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:35.258691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660cc9-2642-4002-81dc-8360d405df60 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:35.258961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660cc9-2642-4002-81dc-8360d405df60 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:35.259691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23660cc9-2642-4002-81dc-8360d405df60 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:35.259997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23660cc9-2642-4002-81dc-8360d405df60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:35.261378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23660cc9-2642-4002-81dc-8360d405df60 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:35.267235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 409/837] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:36.124880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529cbc4-4753-43f6-814b-c5feb38f473e None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.125658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529cbc4-4753-43f6-814b-c5feb38f473e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.125658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529cbc4-4753-43f6-814b-c5feb38f473e None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.127109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 429/838] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:36.133019 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83416152-ab3a-4758-86eb-72388b88c1ba None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.133746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83416152-ab3a-4758-86eb-72388b88c1ba None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.133746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83416152-ab3a-4758-86eb-72388b88c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.152947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-83416152-ab3a-4758-86eb-72388b88c1ba None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:36.154793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-83416152-ab3a-4758-86eb-72388b88c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.239093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 410/839] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:36.261176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529cbc4-4753-43f6-814b-c5feb38f473e None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.374553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d4dc8-33ea-43a4-bb06-81d246167990 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.374834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d4dc8-33ea-43a4-bb06-81d246167990 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.375231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d4dc8-33ea-43a4-bb06-81d246167990 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.375419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529cbc4-4753-43f6-814b-c5feb38f473e None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.378142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 411/840] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:43:36.382772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb8acd-d116-4748-b0db-3a4ea0e14843 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.383118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb8acd-d116-4748-b0db-3a4ea0e14843 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.383388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb8acd-d116-4748-b0db-3a4ea0e14843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.403216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-fddb8acd-d116-4748-b0db-3a4ea0e14843 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:36.405208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fddb8acd-d116-4748-b0db-3a4ea0e14843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.414126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255856-2b58-4a46-97a5-61507a6b3120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.415042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255856-2b58-4a46-97a5-61507a6b3120 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.415415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255856-2b58-4a46-97a5-61507a6b3120 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.415732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255856-2b58-4a46-97a5-61507a6b3120 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.416398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f255856-2b58-4a46-97a5-61507a6b3120 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.418054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f255856-2b58-4a46-97a5-61507a6b3120 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-7f255856-2b58-4a46-97a5-61507a6b3120 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:36.439248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:36.441694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:36.444337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 430/841] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:36.447233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255856-2b58-4a46-97a5-61507a6b3120 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.496513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:36.506697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 412/842] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:36.529828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb8acd-d116-4748-b0db-3a4ea0e14843 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.543106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:36.570207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255856-2b58-4a46-97a5-61507a6b3120 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.612298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2500a-b9c4-4272-8fb7-0ba7f8c2830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.613447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2500a-b9c4-4272-8fb7-0ba7f8c2830c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.613737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2500a-b9c4-4272-8fb7-0ba7f8c2830c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.614026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2500a-b9c4-4272-8fb7-0ba7f8c2830c None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.615103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2500a-b9c4-4272-8fb7-0ba7f8c2830c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:36.615418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2500a-b9c4-4272-8fb7-0ba7f8c2830c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.617456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2500a-b9c4-4272-8fb7-0ba7f8c2830c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.623694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 431/843] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:36.629535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92931341-dfc4-4afb-b884-f5a9bf972193 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.629764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92931341-dfc4-4afb-b884-f5a9bf972193 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.630044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92931341-dfc4-4afb-b884-f5a9bf972193 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.631478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 432/844] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:36.632091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92931341-dfc4-4afb-b884-f5a9bf972193 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.644220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb8acd-d116-4748-b0db-3a4ea0e14843 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.681780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94433d95-fb50-4441-b30f-425fa900a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.682595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94433d95-fb50-4441-b30f-425fa900a107 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.682866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94433d95-fb50-4441-b30f-425fa900a107 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.683139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94433d95-fb50-4441-b30f-425fa900a107 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.701516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94433d95-fb50-4441-b30f-425fa900a107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-94433d95-fb50-4441-b30f-425fa900a107 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:36.715032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:36.716136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:43:36.717283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:36.721846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 413/845] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:36.723120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31f4b6-f765-4319-bcc5-1d810004b1ad None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.723414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31f4b6-f765-4319-bcc5-1d810004b1ad None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.723714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31f4b6-f765-4319-bcc5-1d810004b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.742737 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1c31f4b6-f765-4319-bcc5-1d810004b1ad None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:36.743975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1c31f4b6-f765-4319-bcc5-1d810004b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:36.761411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92931341-dfc4-4afb-b884-f5a9bf972193 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:36.763773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:36.797824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1e69-d6f4-47b5-bf90-2feb01a45252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:36.798495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1e69-d6f4-47b5-bf90-2feb01a45252 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:36.798780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1e69-d6f4-47b5-bf90-2feb01a45252 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:36.799052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1e69-d6f4-47b5-bf90-2feb01a45252 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:36.799811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1e69-d6f4-47b5-bf90-2feb01a45252 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:36.800093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1e69-d6f4-47b5-bf90-2feb01a45252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:36.801505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1e69-d6f4-47b5-bf90-2feb01a45252 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:36.812220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 433/846] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:36.813085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1e69-d6f4-47b5-bf90-2feb01a45252 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.826425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:36.834330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 414/847] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:36.859281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31f4b6-f765-4319-bcc5-1d810004b1ad None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:36.967845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1e69-d6f4-47b5-bf90-2feb01a45252 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.003303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31f4b6-f765-4319-bcc5-1d810004b1ad None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.026017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af49cd-63ea-4d62-85d2-27c79a2c1c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.026241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af49cd-63ea-4d62-85d2-27c79a2c1c10 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.026545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af49cd-63ea-4d62-85d2-27c79a2c1c10 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.027198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af49cd-63ea-4d62-85d2-27c79a2c1c10 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.030622 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af49cd-63ea-4d62-85d2-27c79a2c1c10 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:37.030934 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af49cd-63ea-4d62-85d2-27c79a2c1c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.034439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af49cd-63ea-4d62-85d2-27c79a2c1c10 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.059037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 434/848] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:37.062050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af49cd-63ea-4d62-85d2-27c79a2c1c10 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.081885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0df72-9281-45ff-943a-794b9650949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.081885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0df72-9281-45ff-943a-794b9650949d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.082547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0df72-9281-45ff-943a-794b9650949d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.082974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0df72-9281-45ff-943a-794b9650949d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.095410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.102480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0df72-9281-45ff-943a-794b9650949d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9bb0df72-9281-45ff-943a-794b9650949d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:37.112919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:37.114217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:43:37.115200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:37.117689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 415/849] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:37.127585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0df72-9281-45ff-943a-794b9650949d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.196462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.206650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af49cd-63ea-4d62-85d2-27c79a2c1c10 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.247314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0df72-9281-45ff-943a-794b9650949d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.297381 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113db9b5-e5e3-4ab8-a44c-fb560cf0511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.298768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113db9b5-e5e3-4ab8-a44c-fb560cf0511b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.299322 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113db9b5-e5e3-4ab8-a44c-fb560cf0511b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.299861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113db9b5-e5e3-4ab8-a44c-fb560cf0511b None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.300915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113db9b5-e5e3-4ab8-a44c-fb560cf0511b None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:37.301589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113db9b5-e5e3-4ab8-a44c-fb560cf0511b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.303443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113db9b5-e5e3-4ab8-a44c-fb560cf0511b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.308083 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b78f1-a491-4b1b-9f47-3db64495abad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.308916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b78f1-a491-4b1b-9f47-3db64495abad None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.313314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b78f1-a491-4b1b-9f47-3db64495abad None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.313778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b78f1-a491-4b1b-9f47-3db64495abad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.322330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 416/850] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:37.323691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113db9b5-e5e3-4ab8-a44c-fb560cf0511b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.342804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b78f1-a491-4b1b-9f47-3db64495abad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.344349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b78f1-a491-4b1b-9f47-3db64495abad None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-091b78f1-a491-4b1b-9f47-3db64495abad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:37.385459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:37.386444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:37.387352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:37.387352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:37.387352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:37.387352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:37.390152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 435/851] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:37.404736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b78f1-a491-4b1b-9f47-3db64495abad None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.471904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113db9b5-e5e3-4ab8-a44c-fb560cf0511b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.500266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.519845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f743a5-146c-47e0-85fb-384bf999be2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.520650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f743a5-146c-47e0-85fb-384bf999be2c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.520935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f743a5-146c-47e0-85fb-384bf999be2c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.521212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f743a5-146c-47e0-85fb-384bf999be2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.548748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f743a5-146c-47e0-85fb-384bf999be2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.550240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f743a5-146c-47e0-85fb-384bf999be2c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-65f743a5-146c-47e0-85fb-384bf999be2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:37.594467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:37.595498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:37.596513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:37.596513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:37.596513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:37.596513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:37.597925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 417/852] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:37.601884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f743a5-146c-47e0-85fb-384bf999be2c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.606811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.642297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b78f1-a491-4b1b-9f47-3db64495abad None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.699352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ffe03-3551-4dc7-aa70-efe2de4553f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.700871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ffe03-3551-4dc7-aa70-efe2de4553f6 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.701166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ffe03-3551-4dc7-aa70-efe2de4553f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.701447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ffe03-3551-4dc7-aa70-efe2de4553f6 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.702183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ffe03-3551-4dc7-aa70-efe2de4553f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:37.702493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ffe03-3551-4dc7-aa70-efe2de4553f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.704843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ffe03-3551-4dc7-aa70-efe2de4553f6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.725860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 436/853] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:37.727493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ffe03-3551-4dc7-aa70-efe2de4553f6 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.752377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f743a5-146c-47e0-85fb-384bf999be2c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.790860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2670-fd42-47ec-bcfe-9c9f9f1b1853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.791663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2670-fd42-47ec-bcfe-9c9f9f1b1853 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.791928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2670-fd42-47ec-bcfe-9c9f9f1b1853 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.792214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2670-fd42-47ec-bcfe-9c9f9f1b1853 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.792941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2670-fd42-47ec-bcfe-9c9f9f1b1853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:37.793277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2670-fd42-47ec-bcfe-9c9f9f1b1853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.795333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2670-fd42-47ec-bcfe-9c9f9f1b1853 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.809136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 418/854] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:37.814929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2670-fd42-47ec-bcfe-9c9f9f1b1853 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.834449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ffe03-3551-4dc7-aa70-efe2de4553f6 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.863909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.877562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344ebdf-6a98-4f74-b8ba-18e3c9343a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.878729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344ebdf-6a98-4f74-b8ba-18e3c9343a12 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.879235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344ebdf-6a98-4f74-b8ba-18e3c9343a12 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.879765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344ebdf-6a98-4f74-b8ba-18e3c9343a12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.888094 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344ebdf-6a98-4f74-b8ba-18e3c9343a12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.889967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344ebdf-6a98-4f74-b8ba-18e3c9343a12 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:37.893392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-5344ebdf-6a98-4f74-b8ba-18e3c9343a12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:37.907321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:37.908929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:37.909935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:37.913652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 437/855] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:37.914968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344ebdf-6a98-4f74-b8ba-18e3c9343a12 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:37.939605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2670-fd42-47ec-bcfe-9c9f9f1b1853 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:37.979264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b66f6-ed50-4722-b3c9-e4825c5a9c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:37.980596 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b66f6-ed50-4722-b3c9-e4825c5a9c30 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:37.981121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b66f6-ed50-4722-b3c9-e4825c5a9c30 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:37.982243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b66f6-ed50-4722-b3c9-e4825c5a9c30 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:37.991313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b66f6-ed50-4722-b3c9-e4825c5a9c30 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:37.993169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b66f6-ed50-4722-b3c9-e4825c5a9c30 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-f84b66f6-ed50-4722-b3c9-e4825c5a9c30 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:38.010648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:38.011841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:43:38.012863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:38.020200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 419/856] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:38.021366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b66f6-ed50-4722-b3c9-e4825c5a9c30 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.021636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344ebdf-6a98-4f74-b8ba-18e3c9343a12 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.058884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c1db0-7877-480a-a4c1-01cfa932ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.059999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c1db0-7877-480a-a4c1-01cfa932ed40 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.060482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c1db0-7877-480a-a4c1-01cfa932ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.061025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c1db0-7877-480a-a4c1-01cfa932ed40 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.062139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c1db0-7877-480a-a4c1-01cfa932ed40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:38.062438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c1db0-7877-480a-a4c1-01cfa932ed40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.063888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c1db0-7877-480a-a4c1-01cfa932ed40 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.088578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 438/857] 10.222.0.93 () {56 vars in 1149 bytes} [Thu May 26 16:43:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:38.096834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c1db0-7877-480a-a4c1-01cfa932ed40 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.156066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b66f6-ed50-4722-b3c9-e4825c5a9c30 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.166201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:38.176569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:38.194693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d179-b629-447d-ac46-8eead136ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.195514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d179-b629-447d-ac46-8eead136ecfb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.195973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d179-b629-447d-ac46-8eead136ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.196335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d179-b629-447d-ac46-8eead136ecfb None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.197339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2d179-b629-447d-ac46-8eead136ecfb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:38.197896 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2d179-b629-447d-ac46-8eead136ecfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.199226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2d179-b629-447d-ac46-8eead136ecfb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.220672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c1db0-7877-480a-a4c1-01cfa932ed40 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.225254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 420/858] 10.222.0.93 () {56 vars in 1135 bytes} [Thu May 26 16:43:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:38.226313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d179-b629-447d-ac46-8eead136ecfb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.264747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc8076-0a48-459d-8d38-f60e80a50a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.266428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8076-0a48-459d-8d38-f60e80a50a18 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.266872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8076-0a48-459d-8d38-f60e80a50a18 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.267292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8076-0a48-459d-8d38-f60e80a50a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.346200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d179-b629-447d-ac46-8eead136ecfb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.352190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc8076-0a48-459d-8d38-f60e80a50a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.353833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc8076-0a48-459d-8d38-f60e80a50a18 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.395700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d87c1-5954-4cde-939f-2eff2e35fc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.396635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d87c1-5954-4cde-939f-2eff2e35fc01 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.397079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d87c1-5954-4cde-939f-2eff2e35fc01 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.397507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d87c1-5954-4cde-939f-2eff2e35fc01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.426845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:38.432855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:38.488306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d87c1-5954-4cde-939f-2eff2e35fc01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.490289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d87c1-5954-4cde-939f-2eff2e35fc01 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.495320 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 439/859] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:43:38.508635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc8076-0a48-459d-8d38-f60e80a50a18 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.600563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 421/860] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:43:38.606199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d87c1-5954-4cde-939f-2eff2e35fc01 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.619655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc8076-0a48-459d-8d38-f60e80a50a18 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.682386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:38.682751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e459aa1-4bf5-4d18-a4cf-16eb25505d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.684198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459aa1-4bf5-4d18-a4cf-16eb25505d63 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.685164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459aa1-4bf5-4d18-a4cf-16eb25505d63 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.685546 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459aa1-4bf5-4d18-a4cf-16eb25505d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.704609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e459aa1-4bf5-4d18-a4cf-16eb25505d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.706901 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e459aa1-4bf5-4d18-a4cf-16eb25505d63 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-8e459aa1-4bf5-4d18-a4cf-16eb25505d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:38.736923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:38.737955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:38.738868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:38.738868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:38.738868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:38.738868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:38.739592 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 440/861] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:38.745482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e459aa1-4bf5-4d18-a4cf-16eb25505d63 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.760357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d87c1-5954-4cde-939f-2eff2e35fc01 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.762261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:38.802343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fe2a4-9891-4a51-9e9d-b6e14c428188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.803893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe2a4-9891-4a51-9e9d-b6e14c428188 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.804505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe2a4-9891-4a51-9e9d-b6e14c428188 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.804990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe2a4-9891-4a51-9e9d-b6e14c428188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.819613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe2a4-9891-4a51-9e9d-b6e14c428188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.821530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe2a4-9891-4a51-9e9d-b6e14c428188 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-431fe2a4-9891-4a51-9e9d-b6e14c428188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:38.844772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:38.845779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:38.846702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:38.846702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:38.846702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:38.846702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:38.854220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 422/862] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:38.855731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fe2a4-9891-4a51-9e9d-b6e14c428188 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.870568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e459aa1-4bf5-4d18-a4cf-16eb25505d63 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.912879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f175-e68b-4c32-a6c6-253d4f8b10d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:38.913484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f175-e68b-4c32-a6c6-253d4f8b10d8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:38.913766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f175-e68b-4c32-a6c6-253d4f8b10d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:38.914040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f175-e68b-4c32-a6c6-253d4f8b10d8 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:38.914766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f175-e68b-4c32-a6c6-253d4f8b10d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:38.915069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f175-e68b-4c32-a6c6-253d4f8b10d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:38.916587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f175-e68b-4c32-a6c6-253d4f8b10d8 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:38.929884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 441/863] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:38.935817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f175-e68b-4c32-a6c6-253d4f8b10d8 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:38.979501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fe2a4-9891-4a51-9e9d-b6e14c428188 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:38.982875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:39.013715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:39.023794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552ac3-88a7-498f-b277-ce69f66a2f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.025245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552ac3-88a7-498f-b277-ce69f66a2f71 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.025497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552ac3-88a7-498f-b277-ce69f66a2f71 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.026259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552ac3-88a7-498f-b277-ce69f66a2f71 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.027118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a552ac3-88a7-498f-b277-ce69f66a2f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:39.027524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a552ac3-88a7-498f-b277-ce69f66a2f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.029230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a552ac3-88a7-498f-b277-ce69f66a2f71 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.048052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 423/864] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:39.049904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552ac3-88a7-498f-b277-ce69f66a2f71 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.051266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f175-e68b-4c32-a6c6-253d4f8b10d8 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.114605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e1397-fded-4079-9add-ebed6f6f54fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.115859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1397-fded-4079-9add-ebed6f6f54fd None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.116340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1397-fded-4079-9add-ebed6f6f54fd None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.116809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1397-fded-4079-9add-ebed6f6f54fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.130126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1397-fded-4079-9add-ebed6f6f54fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.132956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1397-fded-4079-9add-ebed6f6f54fd None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-330e1397-fded-4079-9add-ebed6f6f54fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:39.159631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:39.160721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:39.161736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:39.161736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:39.161736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:39.161736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:39.161736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:39.161736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:39.161736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:39.161736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:39.162479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 442/865] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:39.164308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330783e-472c-4b99-b7ce-7d701cae0a8c None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.164760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330783e-472c-4b99-b7ce-7d701cae0a8c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.165204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330783e-472c-4b99-b7ce-7d701cae0a8c None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.167767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 443/866] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:39.169426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330783e-472c-4b99-b7ce-7d701cae0a8c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.221360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552ac3-88a7-498f-b277-ce69f66a2f71 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.259771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedbfe4-48b3-4b60-aa02-ca8c64eb87b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.260568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedbfe4-48b3-4b60-aa02-ca8c64eb87b3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.260852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedbfe4-48b3-4b60-aa02-ca8c64eb87b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.261129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedbfe4-48b3-4b60-aa02-ca8c64eb87b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.268720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedbfe4-48b3-4b60-aa02-ca8c64eb87b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.270177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedbfe4-48b3-4b60-aa02-ca8c64eb87b3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-ebedbfe4-48b3-4b60-aa02-ca8c64eb87b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:39.284534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:39.285865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:39.286928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:39.286928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:39.286928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:39.286928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:39.286928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:39.286928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:39.286928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:39.286928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:39.286928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 424/867] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:39.287425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4bdb7-376b-4a1d-9e6a-ab53ad34a03b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.287600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4bdb7-376b-4a1d-9e6a-ab53ad34a03b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.287879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4bdb7-376b-4a1d-9e6a-ab53ad34a03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.299518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330783e-472c-4b99-b7ce-7d701cae0a8c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.305142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-faf4bdb7-376b-4a1d-9e6a-ab53ad34a03b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:39.306349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-faf4bdb7-376b-4a1d-9e6a-ab53ad34a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:39.324157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:39.330028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:39.337271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732057d-b101-40ba-9ed0-4adae8329136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.342506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732057d-b101-40ba-9ed0-4adae8329136 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.342506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732057d-b101-40ba-9ed0-4adae8329136 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.342506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732057d-b101-40ba-9ed0-4adae8329136 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.342506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732057d-b101-40ba-9ed0-4adae8329136 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:39.342506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732057d-b101-40ba-9ed0-4adae8329136 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.342506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732057d-b101-40ba-9ed0-4adae8329136 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.353890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 444/868] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:39.355231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c157d3-cf03-4276-906a-24d2c2b0381d None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.355517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c157d3-cf03-4276-906a-24d2c2b0381d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.355822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c157d3-cf03-4276-906a-24d2c2b0381d None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.357596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 445/869] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:39.358290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c157d3-cf03-4276-906a-24d2c2b0381d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.377775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 425/870] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:39.378764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4bdb7-376b-4a1d-9e6a-ab53ad34a03b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.477902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c157d3-cf03-4276-906a-24d2c2b0381d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.495421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4bdb7-376b-4a1d-9e6a-ab53ad34a03b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.516965 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5aedc-af5f-4779-b205-23c29cf3a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.517600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5aedc-af5f-4779-b205-23c29cf3a331 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.517885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5aedc-af5f-4779-b205-23c29cf3a331 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.518166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5aedc-af5f-4779-b205-23c29cf3a331 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.518952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5aedc-af5f-4779-b205-23c29cf3a331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:39.519267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5aedc-af5f-4779-b205-23c29cf3a331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.520741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5aedc-af5f-4779-b205-23c29cf3a331 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.531372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754e1e6-08fe-4439-af61-45f43db7cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.532050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e1e6-08fe-4439-af61-45f43db7cb7c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.532327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e1e6-08fe-4439-af61-45f43db7cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.532601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e1e6-08fe-4439-af61-45f43db7cb7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.533484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754e1e6-08fe-4439-af61-45f43db7cb7c None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=58fb392b863c48cb9c6ae5c209e9cac3) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:39.533763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754e1e6-08fe-4439-af61-45f43db7cb7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.535196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754e1e6-08fe-4439-af61-45f43db7cb7c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.536062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 446/871] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:39.539059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4929bf-5c82-4480-ab42-03e93a7ba0cc None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.539614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4929bf-5c82-4480-ab42-03e93a7ba0cc None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.540161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4929bf-5c82-4480-ab42-03e93a7ba0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.551628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 426/872] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:39 2022] GET /identity/v3/role_assignments?user.id=58fb392b863c48cb9c6ae5c209e9cac3&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:39.551628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754e1e6-08fe-4439-af61-45f43db7cb7c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.569459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9c4929bf-5c82-4480-ab42-03e93a7ba0cc None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:39.571632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9c4929bf-5c82-4480-ab42-03e93a7ba0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:39.576092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:39.652748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:39.688191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 447/873] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:39.689589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4929bf-5c82-4480-ab42-03e93a7ba0cc None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.717235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754e1e6-08fe-4439-af61-45f43db7cb7c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.764454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d778-d52b-43ed-bb3e-35aa5406630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.765108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d778-d52b-43ed-bb3e-35aa5406630b None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.765393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d778-d52b-43ed-bb3e-35aa5406630b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.765669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d778-d52b-43ed-bb3e-35aa5406630b None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.766385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32d778-d52b-43ed-bb3e-35aa5406630b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.767818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32d778-d52b-43ed-bb3e-35aa5406630b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.823766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4929bf-5c82-4480-ab42-03e93a7ba0cc None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:39.854266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 427/874] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:43:39 2022] POST /identity/v3/services => generated 269 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:39.855327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d778-d52b-43ed-bb3e-35aa5406630b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:39.883303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e84d2-2bf0-4e40-b11a-70b4d6a3b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:39.884684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e84d2-2bf0-4e40-b11a-70b4d6a3b481 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:39.885143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e84d2-2bf0-4e40-b11a-70b4d6a3b481 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:39.885777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e84d2-2bf0-4e40-b11a-70b4d6a3b481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:39.887197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e84d2-2bf0-4e40-b11a-70b4d6a3b481 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=45cfc967b8634e60b3ddfe4168a748b4) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:39.888198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e84d2-2bf0-4e40-b11a-70b4d6a3b481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:39.889942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e84d2-2bf0-4e40-b11a-70b4d6a3b481 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:39.901246 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 448/875] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:39 2022] GET /identity/v3/role_assignments?user.id=45cfc967b8634e60b3ddfe4168a748b4&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:40.004911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:40.046858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d778-d52b-43ed-bb3e-35aa5406630b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.114365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9fe34-8cca-4522-a0da-70cfa982f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.117344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9fe34-8cca-4522-a0da-70cfa982f7ae None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.117702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9fe34-8cca-4522-a0da-70cfa982f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.118009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9fe34-8cca-4522-a0da-70cfa982f7ae None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.119525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9fe34-8cca-4522-a0da-70cfa982f7ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.121036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9fe34-8cca-4522-a0da-70cfa982f7ae None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.352893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 428/876] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:43:39 2022] POST /identity/v3/services => generated 251 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:42.285169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7a3ff-6de9-49dd-b325-9652cfa0c3e3 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.285706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7a3ff-6de9-49dd-b325-9652cfa0c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.285706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7a3ff-6de9-49dd-b325-9652cfa0c3e3 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.287517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 449/877] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:43:42.294826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89dfc-9262-4c09-b06f-dff196f1e36d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.295391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89dfc-9262-4c09-b06f-dff196f1e36d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.295824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89dfc-9262-4c09-b06f-dff196f1e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.323474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-65c89dfc-9262-4c09-b06f-dff196f1e36d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:42.325692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-65c89dfc-9262-4c09-b06f-dff196f1e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:42.443470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 429/878] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:42.455689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d278f-ac5f-4350-b9eb-51a7023327a4 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.456173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d278f-ac5f-4350-b9eb-51a7023327a4 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.456658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d278f-ac5f-4350-b9eb-51a7023327a4 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.459433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 450/879] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:42.465298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b29a4-c338-49af-9797-8630258912d8 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.466164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b29a4-c338-49af-9797-8630258912d8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.466439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b29a4-c338-49af-9797-8630258912d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.487743 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d72b29a4-c338-49af-9797-8630258912d8 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:42.489010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d72b29a4-c338-49af-9797-8630258912d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:42.491144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d278f-ac5f-4350-b9eb-51a7023327a4 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.555141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:42.582678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:42.593976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 430/880] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:42.596302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694e0ee-df6b-406e-a6ac-635b510f341e None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.596868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694e0ee-df6b-406e-a6ac-635b510f341e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.597382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694e0ee-df6b-406e-a6ac-635b510f341e None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.600126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 431/881] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:42.608408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24929508-6a3d-43ca-af32-42ac6294e462 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.608915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24929508-6a3d-43ca-af32-42ac6294e462 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.609428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24929508-6a3d-43ca-af32-42ac6294e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.635032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-24929508-6a3d-43ca-af32-42ac6294e462 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:42.636276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-24929508-6a3d-43ca-af32-42ac6294e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:42.651906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d278f-ac5f-4350-b9eb-51a7023327a4 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.709690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cb4c9-3011-4408-8792-390438c778ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.711020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cb4c9-3011-4408-8792-390438c778ff None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.711485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cb4c9-3011-4408-8792-390438c778ff None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.711971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cb4c9-3011-4408-8792-390438c778ff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.713065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cb4c9-3011-4408-8792-390438c778ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.715999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cb4c9-3011-4408-8792-390438c778ff None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-950cb4c9-3011-4408-8792-390438c778ff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:42.730478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:42.732940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:42.734601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 451/882] 10.222.0.93 () {56 vars in 1132 bytes} [Thu May 26 16:43:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:42.736235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cb4c9-3011-4408-8792-390438c778ff None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.739738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 432/883] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:42.741314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac362b6-a5ce-47a6-9dbd-3abe00e18ebd None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.741612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac362b6-a5ce-47a6-9dbd-3abe00e18ebd None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.741903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac362b6-a5ce-47a6-9dbd-3abe00e18ebd None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.744188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 433/884] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:42.744188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac362b6-a5ce-47a6-9dbd-3abe00e18ebd None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.865148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cb4c9-3011-4408-8792-390438c778ff None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.867541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:42.872629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac362b6-a5ce-47a6-9dbd-3abe00e18ebd None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:42.898295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:42.904350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f3570-3cb2-46b7-a9ef-05bfb095b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.905240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f3570-3cb2-46b7-a9ef-05bfb095b79d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.905699 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f3570-3cb2-46b7-a9ef-05bfb095b79d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.907173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f3570-3cb2-46b7-a9ef-05bfb095b79d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.907173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f3570-3cb2-46b7-a9ef-05bfb095b79d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.908691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f3570-3cb2-46b7-a9ef-05bfb095b79d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.910621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e86ed-27eb-4ca6-a6ca-72aeb31dfde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:42.911300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e86ed-27eb-4ca6-a6ca-72aeb31dfde9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.911602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e86ed-27eb-4ca6-a6ca-72aeb31dfde9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.911888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e86ed-27eb-4ca6-a6ca-72aeb31dfde9 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.912609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e86ed-27eb-4ca6-a6ca-72aeb31dfde9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:42.912918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e86ed-27eb-4ca6-a6ca-72aeb31dfde9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:42.914310 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e86ed-27eb-4ca6-a6ca-72aeb31dfde9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:42.922196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 434/885] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-611f3570-3cb2-46b7-a9ef-05bfb095b79d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:42.923340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:42.925358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:42.927444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:42.929778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e6a0-2e63-4398-a267-d0244c77d3db None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:42.929778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e6a0-2e63-4398-a267-d0244c77d3db None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:42.929778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e6a0-2e63-4398-a267-d0244c77d3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:42.930155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 452/886] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:42.930762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f3570-3cb2-46b7-a9ef-05bfb095b79d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:42.946221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-02d0e6a0-2e63-4398-a267-d0244c77d3db None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:42.948255 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-02d0e6a0-2e63-4398-a267-d0244c77d3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:43.044522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 435/887] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:43.044522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e6a0-2e63-4398-a267-d0244c77d3db None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.059132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f3570-3cb2-46b7-a9ef-05bfb095b79d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.098082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51c74a-e797-4335-af1a-c7b418230c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.098895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51c74a-e797-4335-af1a-c7b418230c2e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.099179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51c74a-e797-4335-af1a-c7b418230c2e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.099455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51c74a-e797-4335-af1a-c7b418230c2e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.111371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51c74a-e797-4335-af1a-c7b418230c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-9b51c74a-e797-4335-af1a-c7b418230c2e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:43.119720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:43.121821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 453/888] 10.222.0.93 () {56 vars in 1120 bytes} [Thu May 26 16:43:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:43.124467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51c74a-e797-4335-af1a-c7b418230c2e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.159361 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:43.185378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e6a0-2e63-4398-a267-d0244c77d3db None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.207956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:43.227529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e474-9127-4d85-bc1b-eae8a36adadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.228510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e474-9127-4d85-bc1b-eae8a36adadf None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.231170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e474-9127-4d85-bc1b-eae8a36adadf None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.231170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e474-9127-4d85-bc1b-eae8a36adadf None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.231170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e474-9127-4d85-bc1b-eae8a36adadf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:43.231170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e474-9127-4d85-bc1b-eae8a36adadf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.232422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e474-9127-4d85-bc1b-eae8a36adadf None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.238936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 436/889] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:43.239802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e474-9127-4d85-bc1b-eae8a36adadf None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.253409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51c74a-e797-4335-af1a-c7b418230c2e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.292386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529ac13-4c34-4033-ad93-73222772680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.293447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529ac13-4c34-4033-ad93-73222772680c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.293447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529ac13-4c34-4033-ad93-73222772680c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.294286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529ac13-4c34-4033-ad93-73222772680c None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.294973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529ac13-4c34-4033-ad93-73222772680c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:43.295286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529ac13-4c34-4033-ad93-73222772680c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.296896 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529ac13-4c34-4033-ad93-73222772680c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.302641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 454/890] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:43.303487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529ac13-4c34-4033-ad93-73222772680c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.347353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e474-9127-4d85-bc1b-eae8a36adadf None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.384918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f44ac-0fad-480e-b0f6-1f642b813138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.385718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f44ac-0fad-480e-b0f6-1f642b813138 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.385999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f44ac-0fad-480e-b0f6-1f642b813138 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.386277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f44ac-0fad-480e-b0f6-1f642b813138 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.386958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f44ac-0fad-480e-b0f6-1f642b813138 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.388379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f44ac-0fad-480e-b0f6-1f642b813138 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-2a7f44ac-0fad-480e-b0f6-1f642b813138 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:43.400852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:43.402095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:43.403612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 437/891] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:43.404779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f44ac-0fad-480e-b0f6-1f642b813138 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.423583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:43.433031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529ac13-4c34-4033-ad93-73222772680c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.455824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:43.474719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c672e61-d07a-4e2c-bbe2-5a3c72412487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.475381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c672e61-d07a-4e2c-bbe2-5a3c72412487 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.475697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c672e61-d07a-4e2c-bbe2-5a3c72412487 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.475972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c672e61-d07a-4e2c-bbe2-5a3c72412487 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.476852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c672e61-d07a-4e2c-bbe2-5a3c72412487 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:43.477231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c672e61-d07a-4e2c-bbe2-5a3c72412487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.478727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c672e61-d07a-4e2c-bbe2-5a3c72412487 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.488381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 455/892] 10.222.0.93 () {56 vars in 1115 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:43.489335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c672e61-d07a-4e2c-bbe2-5a3c72412487 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.520781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f44ac-0fad-480e-b0f6-1f642b813138 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.560330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061f09b-fcc8-4069-8f7b-ec5cf38342eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.561250 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f09b-fcc8-4069-8f7b-ec5cf38342eb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.561620 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f09b-fcc8-4069-8f7b-ec5cf38342eb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.561945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f09b-fcc8-4069-8f7b-ec5cf38342eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.563024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061f09b-fcc8-4069-8f7b-ec5cf38342eb None admin] RBAC: Adding query filter params (interface=public, service_id=097dbcebb85347a4a9da1ce062e3b25c, region_id=RegionOne) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:43.563426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061f09b-fcc8-4069-8f7b-ec5cf38342eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.565246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061f09b-fcc8-4069-8f7b-ec5cf38342eb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.572435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 438/893] 10.222.0.93 () {56 vars in 1251 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/endpoints?service_id=097dbcebb85347a4a9da1ce062e3b25c&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:43.573799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061f09b-fcc8-4069-8f7b-ec5cf38342eb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.643240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c672e61-d07a-4e2c-bbe2-5a3c72412487 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.685126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72755-3fc0-4a76-b640-c65672086f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.686238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72755-3fc0-4a76-b640-c65672086f5a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.686715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72755-3fc0-4a76-b640-c65672086f5a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.687167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72755-3fc0-4a76-b640-c65672086f5a None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.688419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f72755-3fc0-4a76-b640-c65672086f5a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:43.688893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f72755-3fc0-4a76-b640-c65672086f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.691393 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f72755-3fc0-4a76-b640-c65672086f5a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.698442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 456/894] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:43.699702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72755-3fc0-4a76-b640-c65672086f5a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.724401 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061f09b-fcc8-4069-8f7b-ec5cf38342eb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.736484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:43.740170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:43.771186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560bae3-6599-422c-837d-1d468f3d58e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.771900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560bae3-6599-422c-837d-1d468f3d58e5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.772196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560bae3-6599-422c-837d-1d468f3d58e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.772455 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560bae3-6599-422c-837d-1d468f3d58e5 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.773181 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560bae3-6599-422c-837d-1d468f3d58e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:43.773481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560bae3-6599-422c-837d-1d468f3d58e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.774915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560bae3-6599-422c-837d-1d468f3d58e5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.781360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 439/895] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:43.785186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560bae3-6599-422c-837d-1d468f3d58e5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.857059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72755-3fc0-4a76-b640-c65672086f5a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.917184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd31e2d-79f8-48f4-b46f-c22c5cafecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.917184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd31e2d-79f8-48f4-b46f-c22c5cafecdb None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.917184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd31e2d-79f8-48f4-b46f-c22c5cafecdb None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.917184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd31e2d-79f8-48f4-b46f-c22c5cafecdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.924136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560bae3-6599-422c-837d-1d468f3d58e5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.924565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd31e2d-79f8-48f4-b46f-c22c5cafecdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.926074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd31e2d-79f8-48f4-b46f-c22c5cafecdb None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-7cd31e2d-79f8-48f4-b46f-c22c5cafecdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:43.948534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:43.950888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:43.953555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:43.953555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:43.953555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:43.953555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:43.956033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 457/896] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:43.957848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd31e2d-79f8-48f4-b46f-c22c5cafecdb None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.973948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d3f5-320a-48a1-b5c9-39e1f457650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.974636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d3f5-320a-48a1-b5c9-39e1f457650f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.974918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d3f5-320a-48a1-b5c9-39e1f457650f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.975493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d3f5-320a-48a1-b5c9-39e1f457650f None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.976116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4d3f5-320a-48a1-b5c9-39e1f457650f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.978526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4d3f5-320a-48a1-b5c9-39e1f457650f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.990028 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 440/897] 10.222.0.93 () {56 vars in 1087 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/services => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:43.991112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d3f5-320a-48a1-b5c9-39e1f457650f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.074240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:44.100167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:44.178251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd31e2d-79f8-48f4-b46f-c22c5cafecdb None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.192590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d3f5-320a-48a1-b5c9-39e1f457650f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.247401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5f8ed-f06b-4d0f-b071-59f94081657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.249120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5f8ed-f06b-4d0f-b071-59f94081657c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.249897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5f8ed-f06b-4d0f-b071-59f94081657c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.250648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5f8ed-f06b-4d0f-b071-59f94081657c None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.252234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5f8ed-f06b-4d0f-b071-59f94081657c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:44.253252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5f8ed-f06b-4d0f-b071-59f94081657c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.255992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5f8ed-f06b-4d0f-b071-59f94081657c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.260090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c7e48-bdcb-4e2a-8f36-25d9520bc1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.262195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c7e48-bdcb-4e2a-8f36-25d9520bc1ba None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.263652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c7e48-bdcb-4e2a-8f36-25d9520bc1ba None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.264512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c7e48-bdcb-4e2a-8f36-25d9520bc1ba None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.265984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c7e48-bdcb-4e2a-8f36-25d9520bc1ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:44.266710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c7e48-bdcb-4e2a-8f36-25d9520bc1ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.268298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 458/898] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:44.269749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c7e48-bdcb-4e2a-8f36-25d9520bc1ba None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.277768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5f8ed-f06b-4d0f-b071-59f94081657c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.296376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 441/899] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:44.304901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c7e48-bdcb-4e2a-8f36-25d9520bc1ba None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.428113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:44.432459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c7e48-bdcb-4e2a-8f36-25d9520bc1ba None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.475987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec8574-67d7-4ec5-b83d-ef5d979d63f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.477051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec8574-67d7-4ec5-b83d-ef5d979d63f5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.477341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec8574-67d7-4ec5-b83d-ef5d979d63f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.477621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec8574-67d7-4ec5-b83d-ef5d979d63f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.479949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5f8ed-f06b-4d0f-b071-59f94081657c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.486766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec8574-67d7-4ec5-b83d-ef5d979d63f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.488532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec8574-67d7-4ec5-b83d-ef5d979d63f5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-66ec8574-67d7-4ec5-b83d-ef5d979d63f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:44.508950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:44.510711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:44.513664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:44.523748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 442/900] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:43:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:44.523748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec8574-67d7-4ec5-b83d-ef5d979d63f5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.549788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c03ccc-091d-4097-a06d-f3ff68b8bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.550904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c03ccc-091d-4097-a06d-f3ff68b8bf1e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.551438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c03ccc-091d-4097-a06d-f3ff68b8bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.552050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c03ccc-091d-4097-a06d-f3ff68b8bf1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.553723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c03ccc-091d-4097-a06d-f3ff68b8bf1e None admin] RBAC: Adding query filter params (interface=public, service_id=49d744c2c0e446a6885b4eb74f4ae92c, region_id=RegionOne) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:44.554288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c03ccc-091d-4097-a06d-f3ff68b8bf1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.557152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c03ccc-091d-4097-a06d-f3ff68b8bf1e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.560568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:44.568759 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 459/901] 10.222.0.93 () {56 vars in 1251 bytes} [Thu May 26 16:43:44 2022] GET /identity/v3/endpoints?service_id=49d744c2c0e446a6885b4eb74f4ae92c&interface=public®ion_id=RegionOne => generated 194 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:44.577495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c03ccc-091d-4097-a06d-f3ff68b8bf1e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.639976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec8574-67d7-4ec5-b83d-ef5d979d63f5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.703981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dab8e5-231f-4b73-b9d3-6c289e0494b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.705097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab8e5-231f-4b73-b9d3-6c289e0494b9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.705707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab8e5-231f-4b73-b9d3-6c289e0494b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.706213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab8e5-231f-4b73-b9d3-6c289e0494b9 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.707486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dab8e5-231f-4b73-b9d3-6c289e0494b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:44.708048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dab8e5-231f-4b73-b9d3-6c289e0494b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.710008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dab8e5-231f-4b73-b9d3-6c289e0494b9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.732451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c03ccc-091d-4097-a06d-f3ff68b8bf1e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.738498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 443/902] 10.222.0.93 () {56 vars in 1149 bytes} [Thu May 26 16:43:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:44.739794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dab8e5-231f-4b73-b9d3-6c289e0494b9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.761186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:44.772266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1b5bc-a8f0-4a71-b1fb-b96de95db7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.782491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1b5bc-a8f0-4a71-b1fb-b96de95db7c6 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.782491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1b5bc-a8f0-4a71-b1fb-b96de95db7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.782491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1b5bc-a8f0-4a71-b1fb-b96de95db7c6 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.782491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1b5bc-a8f0-4a71-b1fb-b96de95db7c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.782491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1b5bc-a8f0-4a71-b1fb-b96de95db7c6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.787758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 460/903] 10.222.0.93 () {56 vars in 1087 bytes} [Thu May 26 16:43:44 2022] GET /identity/v3/services => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:44.867681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dab8e5-231f-4b73-b9d3-6c289e0494b9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.912056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37626beb-c857-40c7-bdef-edb1a295010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.913158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37626beb-c857-40c7-bdef-edb1a295010a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.913660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37626beb-c857-40c7-bdef-edb1a295010a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.914150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37626beb-c857-40c7-bdef-edb1a295010a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.006003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37626beb-c857-40c7-bdef-edb1a295010a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:45.007840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37626beb-c857-40c7-bdef-edb1a295010a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:45.028867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:45.124972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 444/904] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:44 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:43:45.130615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1b5bc-a8f0-4a71-b1fb-b96de95db7c6 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:45.233124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:45.281159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1b5bc-a8f0-4a71-b1fb-b96de95db7c6 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:45.338726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b3c4-74bf-44e2-8cf7-3fa066662b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:45.342349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b3c4-74bf-44e2-8cf7-3fa066662b7e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.343135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b3c4-74bf-44e2-8cf7-3fa066662b7e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.343873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b3c4-74bf-44e2-8cf7-3fa066662b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.363059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b3c4-74bf-44e2-8cf7-3fa066662b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:45.364755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b3c4-74bf-44e2-8cf7-3fa066662b7e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-0421b3c4-74bf-44e2-8cf7-3fa066662b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:45.384316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:45.385991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:45.389425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:45.389425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:45.389425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:45.389425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:45.389425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 461/905] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:45.398396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37626beb-c857-40c7-bdef-edb1a295010a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:45.585020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37626beb-c857-40c7-bdef-edb1a295010a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:45.624229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:45.659034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022745b-bb90-482d-9847-2b2f37b5055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:45.660688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022745b-bb90-482d-9847-2b2f37b5055a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.661459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022745b-bb90-482d-9847-2b2f37b5055a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.662218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022745b-bb90-482d-9847-2b2f37b5055a None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.663928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022745b-bb90-482d-9847-2b2f37b5055a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:45.664781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022745b-bb90-482d-9847-2b2f37b5055a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:45.667749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022745b-bb90-482d-9847-2b2f37b5055a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:45.721227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 445/906] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:45.730565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b3c4-74bf-44e2-8cf7-3fa066662b7e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:45.922304 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b3c4-74bf-44e2-8cf7-3fa066662b7e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:45.950811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:45.989082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b88f7-30de-4627-9016-59685639c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:45.990928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b88f7-30de-4627-9016-59685639c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.991693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b88f7-30de-4627-9016-59685639c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.992502 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b88f7-30de-4627-9016-59685639c3b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.008023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b88f7-30de-4627-9016-59685639c3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.011383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b88f7-30de-4627-9016-59685639c3b1 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-1c3b88f7-30de-4627-9016-59685639c3b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:46.040252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:46.041991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:46.044316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:46.044316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:46.044316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:46.044316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:46.044316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:46.044316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:46.044316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:46.044316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:46.048905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 462/907] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:46.058670 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022745b-bb90-482d-9847-2b2f37b5055a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.266645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022745b-bb90-482d-9847-2b2f37b5055a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.339140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed56156-c8ab-4bb7-9016-97939e6d5375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.341325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed56156-c8ab-4bb7-9016-97939e6d5375 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.342359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed56156-c8ab-4bb7-9016-97939e6d5375 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.343132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed56156-c8ab-4bb7-9016-97939e6d5375 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.344982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed56156-c8ab-4bb7-9016-97939e6d5375 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:46.345839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed56156-c8ab-4bb7-9016-97939e6d5375 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.348927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed56156-c8ab-4bb7-9016-97939e6d5375 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.374361 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 446/908] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:46.384565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b88f7-30de-4627-9016-59685639c3b1 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.552110 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b88f7-30de-4627-9016-59685639c3b1 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.621268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd6062-27fe-4891-9a9c-f29e5a671c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.622910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd6062-27fe-4891-9a9c-f29e5a671c44 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.623406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd6062-27fe-4891-9a9c-f29e5a671c44 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.623947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd6062-27fe-4891-9a9c-f29e5a671c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.625554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd6062-27fe-4891-9a9c-f29e5a671c44 None admin] RBAC: Adding query filter params (role.id=a99210ab096549e8bebb05c3d5010884, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=58fb392b863c48cb9c6ae5c209e9cac3) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:46.626106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd6062-27fe-4891-9a9c-f29e5a671c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.628892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd6062-27fe-4891-9a9c-f29e5a671c44 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.640443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 463/909] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/role_assignments?user.id=58fb392b863c48cb9c6ae5c209e9cac3&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a99210ab096549e8bebb05c3d5010884 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:47.194543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7b44-8fdb-4072-8a23-e6cc385d969d None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.195089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7b44-8fdb-4072-8a23-e6cc385d969d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.195531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7b44-8fdb-4072-8a23-e6cc385d969d None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.198768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 447/910] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:47.208231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b38809-78f6-49db-9781-ad3c8d906e42 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.208783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b38809-78f6-49db-9781-ad3c8d906e42 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.209476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b38809-78f6-49db-9781-ad3c8d906e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.241529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c9b38809-78f6-49db-9781-ad3c8d906e42 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:47.243726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c9b38809-78f6-49db-9781-ad3c8d906e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:47.314614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:47.386217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 464/911] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:47.401122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f58be-eb55-40cc-84e6-2d64f21f0a41 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.401492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f58be-eb55-40cc-84e6-2d64f21f0a41 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.401910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f58be-eb55-40cc-84e6-2d64f21f0a41 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.404492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 448/912] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:47.410239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee791e-f36e-4282-9b35-fb1a3e6dc9c6 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.410536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee791e-f36e-4282-9b35-fb1a3e6dc9c6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.410818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee791e-f36e-4282-9b35-fb1a3e6dc9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.427750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f58be-eb55-40cc-84e6-2d64f21f0a41 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:47.429135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-75ee791e-f36e-4282-9b35-fb1a3e6dc9c6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:47.430339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-75ee791e-f36e-4282-9b35-fb1a3e6dc9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:47.502364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:47.507068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 465/913] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:47.532884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee791e-f36e-4282-9b35-fb1a3e6dc9c6 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:47.636038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f58be-eb55-40cc-84e6-2d64f21f0a41 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:47.668229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:47.681433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee791e-f36e-4282-9b35-fb1a3e6dc9c6 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:47.695523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea8ece-ae18-4cfa-ae8f-1fb192fec2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:47.696223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8ece-ae18-4cfa-ae8f-1fb192fec2c9 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.696564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8ece-ae18-4cfa-ae8f-1fb192fec2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.696809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8ece-ae18-4cfa-ae8f-1fb192fec2c9 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.699387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea8ece-ae18-4cfa-ae8f-1fb192fec2c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:47.701369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea8ece-ae18-4cfa-ae8f-1fb192fec2c9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:47.732812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1384-905f-4df3-a7cb-7ea73d53f4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:47.734031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1384-905f-4df3-a7cb-7ea73d53f4c0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.734487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1384-905f-4df3-a7cb-7ea73d53f4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.735115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1384-905f-4df3-a7cb-7ea73d53f4c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.736023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa1384-905f-4df3-a7cb-7ea73d53f4c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:47.737578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa1384-905f-4df3-a7cb-7ea73d53f4c0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-99fa1384-905f-4df3-a7cb-7ea73d53f4c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:47.751919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:47.753376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:43:47.754653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:47.759825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 466/914] 10.222.0.93 () {56 vars in 1132 bytes} [Thu May 26 16:43:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:47.764720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1384-905f-4df3-a7cb-7ea73d53f4c0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:47.830976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 449/915] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:43:47 2022] POST /identity/v3/services => generated 241 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:47.844097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315806bf-dc05-4849-bf14-86b4c5fd74b3 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.844429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315806bf-dc05-4849-bf14-86b4c5fd74b3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.844669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315806bf-dc05-4849-bf14-86b4c5fd74b3 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.851076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 450/916] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:43:47.853156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b133-2b84-45b2-a35c-ae4f35d5a67e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.853767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b133-2b84-45b2-a35c-ae4f35d5a67e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.854255 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b133-2b84-45b2-a35c-ae4f35d5a67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.876347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-4de6b133-2b84-45b2-a35c-ae4f35d5a67e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:47.878064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4de6b133-2b84-45b2-a35c-ae4f35d5a67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:47.914854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1384-905f-4df3-a7cb-7ea73d53f4c0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:47.979701 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ca4d4-7813-45c8-8177-290b77b465d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:47.980402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 451/917] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:47.980515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ca4d4-7813-45c8-8177-290b77b465d6 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.980730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ca4d4-7813-45c8-8177-290b77b465d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.983611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ca4d4-7813-45c8-8177-290b77b465d6 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.983611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ca4d4-7813-45c8-8177-290b77b465d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:47.983611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ca4d4-7813-45c8-8177-290b77b465d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:47.983611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ca4d4-7813-45c8-8177-290b77b465d6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:47.989829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 467/918] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:47.999621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b133-2b84-45b2-a35c-ae4f35d5a67e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:48.002520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ca4d4-7813-45c8-8177-290b77b465d6 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:48.048887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:48.054724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:48.155430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ca4d4-7813-45c8-8177-290b77b465d6 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:48.164357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b133-2b84-45b2-a35c-ae4f35d5a67e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:48.207448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db6ef3-14b9-43d6-9793-27bce3908f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:48.208530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db6ef3-14b9-43d6-9793-27bce3908f20 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:48.208530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db6ef3-14b9-43d6-9793-27bce3908f20 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:48.208799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db6ef3-14b9-43d6-9793-27bce3908f20 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:48.209650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db6ef3-14b9-43d6-9793-27bce3908f20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:48.209973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db6ef3-14b9-43d6-9793-27bce3908f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:48.211405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db6ef3-14b9-43d6-9793-27bce3908f20 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:48.223202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 452/919] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:48.227388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db6ef3-14b9-43d6-9793-27bce3908f20 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:48.228919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb094fd-8ee4-49e3-82f6-f6991618d377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:48.229816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb094fd-8ee4-49e3-82f6-f6991618d377 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:48.230080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb094fd-8ee4-49e3-82f6-f6991618d377 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:48.230322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb094fd-8ee4-49e3-82f6-f6991618d377 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:48.231549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb094fd-8ee4-49e3-82f6-f6991618d377 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:48.233036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb094fd-8ee4-49e3-82f6-f6991618d377 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-8bb094fd-8ee4-49e3-82f6-f6991618d377 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:48.251610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:48.252753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:48.253632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 468/920] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:43:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:48.256388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb094fd-8ee4-49e3-82f6-f6991618d377 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:48.349098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:48.368669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db6ef3-14b9-43d6-9793-27bce3908f20 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:48.391243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:48.413067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb094fd-8ee4-49e3-82f6-f6991618d377 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:48.424852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee69381-8c8b-45c4-997b-3964a140717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:48.425985 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee69381-8c8b-45c4-997b-3964a140717f None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:48.426444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee69381-8c8b-45c4-997b-3964a140717f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:48.426883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee69381-8c8b-45c4-997b-3964a140717f None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:48.428649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee69381-8c8b-45c4-997b-3964a140717f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:48.430572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee69381-8c8b-45c4-997b-3964a140717f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:48.458578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61601246-728d-48b6-a0e0-ed0eb8df2177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:48.459346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61601246-728d-48b6-a0e0-ed0eb8df2177 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:48.459669 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61601246-728d-48b6-a0e0-ed0eb8df2177 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:48.461302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61601246-728d-48b6-a0e0-ed0eb8df2177 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:48.461302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61601246-728d-48b6-a0e0-ed0eb8df2177 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:48.461302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61601246-728d-48b6-a0e0-ed0eb8df2177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:48.462703 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61601246-728d-48b6-a0e0-ed0eb8df2177 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:48.471644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 469/921] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:43:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:48.476182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61601246-728d-48b6-a0e0-ed0eb8df2177 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:48.529182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 453/922] 10.222.0.93 () {60 vars in 1144 bytes} [Thu May 26 16:43:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:48.654853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61601246-728d-48b6-a0e0-ed0eb8df2177 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:48.727595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814d4af-a8ed-4ca0-a429-d3fe04a71990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:48.728282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d4af-a8ed-4ca0-a429-d3fe04a71990 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:48.728574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d4af-a8ed-4ca0-a429-d3fe04a71990 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:48.728832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d4af-a8ed-4ca0-a429-d3fe04a71990 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:48.729559 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814d4af-a8ed-4ca0-a429-d3fe04a71990 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:48.729869 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814d4af-a8ed-4ca0-a429-d3fe04a71990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:48.731842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814d4af-a8ed-4ca0-a429-d3fe04a71990 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:48.738454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 470/923] 10.222.0.93 () {56 vars in 1114 bytes} [Thu May 26 16:43:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:48.747979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee69381-8c8b-45c4-997b-3964a140717f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:48.954897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee69381-8c8b-45c4-997b-3964a140717f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:49.022138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728bee8-32dc-495f-9a92-e5f79e6dd323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:49.023249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728bee8-32dc-495f-9a92-e5f79e6dd323 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:49.023793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728bee8-32dc-495f-9a92-e5f79e6dd323 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:49.024292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728bee8-32dc-495f-9a92-e5f79e6dd323 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:49.025711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728bee8-32dc-495f-9a92-e5f79e6dd323 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:49.028981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728bee8-32dc-495f-9a92-e5f79e6dd323 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:49.190852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:49.209405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 454/924] 10.222.0.93 () {60 vars in 1144 bytes} [Thu May 26 16:43:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:50.139692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fb4fc-2200-468f-9c56-ee47ef7ed6ac None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:50.140190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fb4fc-2200-468f-9c56-ee47ef7ed6ac None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:50.140594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fb4fc-2200-468f-9c56-ee47ef7ed6ac None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:50.143477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 471/925] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:43:50.152628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428b52-dee4-4486-8e57-d947c16fa355 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:50.153677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428b52-dee4-4486-8e57-d947c16fa355 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:50.154174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428b52-dee4-4486-8e57-d947c16fa355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:50.182351 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-36428b52-dee4-4486-8e57-d947c16fa355 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:50.184449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-36428b52-dee4-4486-8e57-d947c16fa355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:50.287408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 455/926] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:50.325588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fb4fc-2200-468f-9c56-ee47ef7ed6ac None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:50.350605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:50.472905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fb4fc-2200-468f-9c56-ee47ef7ed6ac None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:50.513730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21584b-5523-48a8-9305-55a6818c5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:50.514604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21584b-5523-48a8-9305-55a6818c5076 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:50.514967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21584b-5523-48a8-9305-55a6818c5076 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:50.515314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21584b-5523-48a8-9305-55a6818c5076 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:50.529653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21584b-5523-48a8-9305-55a6818c5076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-af21584b-5523-48a8-9305-55a6818c5076 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:50.538351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:50.539382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:50.540485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 472/927] 10.222.0.93 () {56 vars in 1120 bytes} [Thu May 26 16:43:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:50.551340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428b52-dee4-4486-8e57-d947c16fa355 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:50.594073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb472a-d9d8-4783-83ac-2e2789571ff1 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:50.594404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb472a-d9d8-4783-83ac-2e2789571ff1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:50.594643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb472a-d9d8-4783-83ac-2e2789571ff1 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:50.596331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 473/928] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:50.602033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2926dc2-052d-48ed-9d3a-952f630d91d0 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:50.602359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2926dc2-052d-48ed-9d3a-952f630d91d0 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:50.602590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2926dc2-052d-48ed-9d3a-952f630d91d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:50.623207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e2926dc2-052d-48ed-9d3a-952f630d91d0 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:50.624843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e2926dc2-052d-48ed-9d3a-952f630d91d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:50.704148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:50.715944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 474/929] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:50.734763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2926dc2-052d-48ed-9d3a-952f630d91d0 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:50.743698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428b52-dee4-4486-8e57-d947c16fa355 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:50.789000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:50.811392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff40c76-e443-45ab-a853-05675584237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:50.813066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff40c76-e443-45ab-a853-05675584237d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:50.813857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff40c76-e443-45ab-a853-05675584237d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:50.814621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff40c76-e443-45ab-a853-05675584237d None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:50.817878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff40c76-e443-45ab-a853-05675584237d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:50.818949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff40c76-e443-45ab-a853-05675584237d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:50.821918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff40c76-e443-45ab-a853-05675584237d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:50.843800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 456/930] 10.222.0.93 () {56 vars in 1115 bytes} [Thu May 26 16:43:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:50.848729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff40c76-e443-45ab-a853-05675584237d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:50.850758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2926dc2-052d-48ed-9d3a-952f630d91d0 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:50.899843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34499889-5481-4400-9d5e-fe11901bc9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:50.900820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34499889-5481-4400-9d5e-fe11901bc9fb None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:50.901247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34499889-5481-4400-9d5e-fe11901bc9fb None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:50.901730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34499889-5481-4400-9d5e-fe11901bc9fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:50.902495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34499889-5481-4400-9d5e-fe11901bc9fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:50.904207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34499889-5481-4400-9d5e-fe11901bc9fb None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-34499889-5481-4400-9d5e-fe11901bc9fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:50.919601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:50.921044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:50.921967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:50.926710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 475/931] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:50.927694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34499889-5481-4400-9d5e-fe11901bc9fb None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:51.011242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:51.056942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34499889-5481-4400-9d5e-fe11901bc9fb None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:51.065088 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff40c76-e443-45ab-a853-05675584237d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:51.098351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b7b78-0e36-4bbd-bc02-2ac1e0b3a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:51.099132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b7b78-0e36-4bbd-bc02-2ac1e0b3a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.099586 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b7b78-0e36-4bbd-bc02-2ac1e0b3a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.100142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b7b78-0e36-4bbd-bc02-2ac1e0b3a7e9 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.101039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b7b78-0e36-4bbd-bc02-2ac1e0b3a7e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:51.101432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b7b78-0e36-4bbd-bc02-2ac1e0b3a7e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:51.103035 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b7b78-0e36-4bbd-bc02-2ac1e0b3a7e9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:51.114726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 476/932] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:43:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:51.115912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b7b78-0e36-4bbd-bc02-2ac1e0b3a7e9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:51.136887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ab1a2-f3d7-47e8-b2bf-df7783cabf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:51.138651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ab1a2-f3d7-47e8-b2bf-df7783cabf97 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.139154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ab1a2-f3d7-47e8-b2bf-df7783cabf97 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.139754 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ab1a2-f3d7-47e8-b2bf-df7783cabf97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.163805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ab1a2-f3d7-47e8-b2bf-df7783cabf97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:51.167049 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ab1a2-f3d7-47e8-b2bf-df7783cabf97 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-878ab1a2-f3d7-47e8-b2bf-df7783cabf97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:51.205678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:51.207868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:51.210071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:51.210071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:51.210071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:51.210071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:51.210071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 457/933] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:51.221196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ab1a2-f3d7-47e8-b2bf-df7783cabf97 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:51.244144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b7b78-0e36-4bbd-bc02-2ac1e0b3a7e9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:51.281017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:51.291059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ff14a-5fe8-40ba-828d-5b9b51a947f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:51.292111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ff14a-5fe8-40ba-828d-5b9b51a947f9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.292625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ff14a-5fe8-40ba-828d-5b9b51a947f9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.293069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ff14a-5fe8-40ba-828d-5b9b51a947f9 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.294046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ff14a-5fe8-40ba-828d-5b9b51a947f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:51.298005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ff14a-5fe8-40ba-828d-5b9b51a947f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:51.298005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ff14a-5fe8-40ba-828d-5b9b51a947f9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:51.303767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 477/934] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:43:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:51.307980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:51.310122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ff14a-5fe8-40ba-828d-5b9b51a947f9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:51.433623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ff14a-5fe8-40ba-828d-5b9b51a947f9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:51.435119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ab1a2-f3d7-47e8-b2bf-df7783cabf97 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:51.477169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7a3a1-2640-4ef9-bba3-c6e830e9a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:51.478243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7a3a1-2640-4ef9-bba3-c6e830e9a5a9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.478843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7a3a1-2640-4ef9-bba3-c6e830e9a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.479348 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7a3a1-2640-4ef9-bba3-c6e830e9a5a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.480467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7a3a1-2640-4ef9-bba3-c6e830e9a5a9 None admin] RBAC: Adding query filter params (interface=public, service_id=69c6a89bd8f0479e8c2279840c38a5d7, region_id=RegionOne) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:51.481654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7a3a1-2640-4ef9-bba3-c6e830e9a5a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:51.483338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7a3a1-2640-4ef9-bba3-c6e830e9a5a9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:51.490386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 478/935] 10.222.0.93 () {56 vars in 1251 bytes} [Thu May 26 16:43:51 2022] GET /identity/v3/endpoints?service_id=69c6a89bd8f0479e8c2279840c38a5d7&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:51.499023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7a3a1-2640-4ef9-bba3-c6e830e9a5a9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:51.510671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6a93e-1323-48ff-85a9-b23e60c7d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:51.511412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6a93e-1323-48ff-85a9-b23e60c7d4da None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.511772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6a93e-1323-48ff-85a9-b23e60c7d4da None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.512056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6a93e-1323-48ff-85a9-b23e60c7d4da None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.513446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6a93e-1323-48ff-85a9-b23e60c7d4da None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:51.513762 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6a93e-1323-48ff-85a9-b23e60c7d4da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:51.515306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6a93e-1323-48ff-85a9-b23e60c7d4da None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:51.529956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 458/936] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:51.540934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6a93e-1323-48ff-85a9-b23e60c7d4da None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:51.603509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:51.669577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:51.680100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6a93e-1323-48ff-85a9-b23e60c7d4da None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:51.704505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7a3a1-2640-4ef9-bba3-c6e830e9a5a9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:51.727148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6db6f4-b257-4169-9c15-555738bdaa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:51.728400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6db6f4-b257-4169-9c15-555738bdaa1d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.728760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6db6f4-b257-4169-9c15-555738bdaa1d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.729346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6db6f4-b257-4169-9c15-555738bdaa1d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.741059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6db6f4-b257-4169-9c15-555738bdaa1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:51.744294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6db6f4-b257-4169-9c15-555738bdaa1d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:51.757440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e9735-c707-4af4-87ec-f6c2e8a669d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:51.758132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e9735-c707-4af4-87ec-f6c2e8a669d0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.758410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e9735-c707-4af4-87ec-f6c2e8a669d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.758680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e9735-c707-4af4-87ec-f6c2e8a669d0 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.759363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e9735-c707-4af4-87ec-f6c2e8a669d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:51.760858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e9735-c707-4af4-87ec-f6c2e8a669d0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-2f6db6f4-b257-4169-9c15-555738bdaa1d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:51.766684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:51.768889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:51.771141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 459/937] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:43:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:51.772480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 479/938] 10.222.0.93 () {56 vars in 1087 bytes} [Thu May 26 16:43:51 2022] GET /identity/v3/services => generated 1497 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:51.780743 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6db6f4-b257-4169-9c15-555738bdaa1d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:51.914446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6db6f4-b257-4169-9c15-555738bdaa1d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:51.964509 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897073-b962-44e0-9d31-28a8df57aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:51.965720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897073-b962-44e0-9d31-28a8df57aad6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.966243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897073-b962-44e0-9d31-28a8df57aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.966757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897073-b962-44e0-9d31-28a8df57aad6 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.968179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897073-b962-44e0-9d31-28a8df57aad6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:51.968739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897073-b962-44e0-9d31-28a8df57aad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:51.970603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897073-b962-44e0-9d31-28a8df57aad6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:52.001031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 460/939] 10.222.0.93 () {56 vars in 1149 bytes} [Thu May 26 16:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:52.007987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e9735-c707-4af4-87ec-f6c2e8a669d0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.151985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e9735-c707-4af4-87ec-f6c2e8a669d0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:52.178130 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4697-1fd8-48ff-998e-56f27de5dda4 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.178329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4697-1fd8-48ff-998e-56f27de5dda4 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.178611 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4697-1fd8-48ff-998e-56f27de5dda4 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.179238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:52.180874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 461/940] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:43:52.187347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062d72-4180-4158-afc3-a2572a5112f2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.187686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062d72-4180-4158-afc3-a2572a5112f2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.187903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062d72-4180-4158-afc3-a2572a5112f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.203110 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b93063-89f2-4810-a524-34da3e43d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:52.204322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b93063-89f2-4810-a524-34da3e43d34b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.204791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b93063-89f2-4810-a524-34da3e43d34b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.205257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b93063-89f2-4810-a524-34da3e43d34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.207217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-cc062d72-4180-4158-afc3-a2572a5112f2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:52.208977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-cc062d72-4180-4158-afc3-a2572a5112f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:52.224398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b93063-89f2-4810-a524-34da3e43d34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:52.225314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:52.228394 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b93063-89f2-4810-a524-34da3e43d34b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-18b93063-89f2-4810-a524-34da3e43d34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:52.254637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:52.258093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:52.261738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:52.261738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:52.261738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:52.261738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:52.267607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 480/941] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:52.267607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920718-1a9a-4f50-b757-75a4d22a16ab None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.267607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920718-1a9a-4f50-b757-75a4d22a16ab None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.267607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920718-1a9a-4f50-b757-75a4d22a16ab None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.270784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 481/942] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:52.272527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56920718-1a9a-4f50-b757-75a4d22a16ab None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.315475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 462/943] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:52.317435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d4aad-f7a9-47c5-a2d7-3ac3a0b22077 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.317734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d4aad-f7a9-47c5-a2d7-3ac3a0b22077 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.318118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d4aad-f7a9-47c5-a2d7-3ac3a0b22077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.340765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-dc6d4aad-f7a9-47c5-a2d7-3ac3a0b22077 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:52.343355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-dc6d4aad-f7a9-47c5-a2d7-3ac3a0b22077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:52.426969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 463/944] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:52.434070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d4aad-f7a9-47c5-a2d7-3ac3a0b22077 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.460856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56920718-1a9a-4f50-b757-75a4d22a16ab None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:52.509307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2fc7-00a5-41d1-9de2-39885adc7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:52.509981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2fc7-00a5-41d1-9de2-39885adc7815 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.510266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2fc7-00a5-41d1-9de2-39885adc7815 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.510544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2fc7-00a5-41d1-9de2-39885adc7815 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.511345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d2fc7-00a5-41d1-9de2-39885adc7815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:52.511685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d2fc7-00a5-41d1-9de2-39885adc7815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:52.513257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d2fc7-00a5-41d1-9de2-39885adc7815 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:52.528630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 482/945] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:52.529267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2fc7-00a5-41d1-9de2-39885adc7815 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.559866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:52.571919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:52.593300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d4aad-f7a9-47c5-a2d7-3ac3a0b22077 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:52.641516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7293466-1e3a-4bd4-9d08-7ece14c93dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:52.642509 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7293466-1e3a-4bd4-9d08-7ece14c93dc8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.642937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7293466-1e3a-4bd4-9d08-7ece14c93dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.643347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7293466-1e3a-4bd4-9d08-7ece14c93dc8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.644339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7293466-1e3a-4bd4-9d08-7ece14c93dc8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:52.646150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7293466-1e3a-4bd4-9d08-7ece14c93dc8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:52.660484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2fc7-00a5-41d1-9de2-39885adc7815 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-c7293466-1e3a-4bd4-9d08-7ece14c93dc8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:52.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:43:52.663895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:52.664684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 464/946] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:52.665920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7293466-1e3a-4bd4-9d08-7ece14c93dc8 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.736602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:52.737853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.738209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.738856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.740121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:52.743018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:52.745062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WARNING keystone.server.flask.common [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:43:52.816730 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7293466-1e3a-4bd4-9d08-7ece14c93dc8 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:52.832745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.sql.core [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:43:52.832745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:43:52.832745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [parameters: {'id': 'b1170b1e95804c86a3f7f69d320e0381', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:43:52.832745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97429) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1170b1e95804c86a3f7f69d320e0381.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1170b1e95804c86a3f7f69d320e0381. May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application conn.query(q) May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:43:52.855962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application result.read() May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 16:43:52.857494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application next(self.gen) May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application yield resource May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application next(self.gen) May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise self.value May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application session.commit() May 26 16:43:52.864235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self.session.flush() May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application compat.raise_( May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:43:52.865201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:43:52.867108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application conn.query(q) May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application result.read() May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:43:52.870185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [parameters: {'id': 'b1170b1e95804c86a3f7f69d320e0381', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:52.872491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:52.875539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1170b1e95804c86a3f7f69d320e0381. May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 483/947] 10.222.0.93 () {60 vars in 1140 bytes} [Thu May 26 16:43:52 2022] POST /identity/v3/projects => generated 262 bytes in 330 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:52.878219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.880484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa341-2fd2-47c8-9e1b-7ee970e7e115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:52.880484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa341-2fd2-47c8-9e1b-7ee970e7e115 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.880484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa341-2fd2-47c8-9e1b-7ee970e7e115 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.880484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa341-2fd2-47c8-9e1b-7ee970e7e115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.892704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafa341-2fd2-47c8-9e1b-7ee970e7e115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:52.900390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafa341-2fd2-47c8-9e1b-7ee970e7e115 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:52.901092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9fafa341-2fd2-47c8-9e1b-7ee970e7e115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:52.926043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:52.928508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 465/948] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:52.931092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa341-2fd2-47c8-9e1b-7ee970e7e115 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.995152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:53.013030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adbab1-743e-4722-9204-d12cb192c9a6 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:53.058032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd04592-e9a0-4aa1-ae35-e1136aa7399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:53.058912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd04592-e9a0-4aa1-ae35-e1136aa7399b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.059326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd04592-e9a0-4aa1-ae35-e1136aa7399b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.059637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd04592-e9a0-4aa1-ae35-e1136aa7399b None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.060358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd04592-e9a0-4aa1-ae35-e1136aa7399b None admin] RBAC: Adding query filter params (name=compute) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:53.072377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd04592-e9a0-4aa1-ae35-e1136aa7399b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:53.072377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd04592-e9a0-4aa1-ae35-e1136aa7399b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.072377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 484/949] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:53.076341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd04592-e9a0-4aa1-ae35-e1136aa7399b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:53.090454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa341-2fd2-47c8-9e1b-7ee970e7e115 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:53.145380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa31620-048e-44c6-a528-523647d286bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:53.146189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa31620-048e-44c6-a528-523647d286bb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.146475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa31620-048e-44c6-a528-523647d286bb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.146751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa31620-048e-44c6-a528-523647d286bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.154568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa31620-048e-44c6-a528-523647d286bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:53.156704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa31620-048e-44c6-a528-523647d286bb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-4fa31620-048e-44c6-a528-523647d286bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:53.172935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:53.174030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:53.174953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:53.174953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:53.174953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:53.174953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:53.174953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:53.174953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:53.174953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:53.174953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:53.179128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 466/950] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:53.179911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa31620-048e-44c6-a528-523647d286bb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:53.232532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd04592-e9a0-4aa1-ae35-e1136aa7399b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:53.255226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:53.273180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9836e-f404-4946-8fd4-b13dadf2b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:53.274232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9836e-f404-4946-8fd4-b13dadf2b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.274232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9836e-f404-4946-8fd4-b13dadf2b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.274422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9836e-f404-4946-8fd4-b13dadf2b4e2 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.275174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9836e-f404-4946-8fd4-b13dadf2b4e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:53.275485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9836e-f404-4946-8fd4-b13dadf2b4e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:53.276966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9836e-f404-4946-8fd4-b13dadf2b4e2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.291223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 485/951] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:53.292113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9836e-f404-4946-8fd4-b13dadf2b4e2 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:53.309738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa31620-048e-44c6-a528-523647d286bb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:53.310919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:53.353621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e94c4-465c-47a5-a83e-b3f5c89d2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:53.355407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e94c4-465c-47a5-a83e-b3f5c89d2dbb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.356549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e94c4-465c-47a5-a83e-b3f5c89d2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.356888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e94c4-465c-47a5-a83e-b3f5c89d2dbb None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.357866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e94c4-465c-47a5-a83e-b3f5c89d2dbb None admin] RBAC: Adding query filter params (type=compute) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:53.358182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e94c4-465c-47a5-a83e-b3f5c89d2dbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:53.360301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e94c4-465c-47a5-a83e-b3f5c89d2dbb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.373542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 467/952] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:53.373542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e94c4-465c-47a5-a83e-b3f5c89d2dbb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:53.425915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9836e-f404-4946-8fd4-b13dadf2b4e2 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:53.471174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13418dd4-413c-4418-ac5b-19f3d0e7cb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:53.471934 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13418dd4-413c-4418-ac5b-19f3d0e7cb97 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.472276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13418dd4-413c-4418-ac5b-19f3d0e7cb97 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.472591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13418dd4-413c-4418-ac5b-19f3d0e7cb97 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.473401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13418dd4-413c-4418-ac5b-19f3d0e7cb97 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:53.474043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13418dd4-413c-4418-ac5b-19f3d0e7cb97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:53.475925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13418dd4-413c-4418-ac5b-19f3d0e7cb97 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.500526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 486/953] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:53.538234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e94c4-465c-47a5-a83e-b3f5c89d2dbb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:53.571995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:53.585194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3ab0-3fd9-48fe-9553-8b8c20c4faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:53.586253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3ab0-3fd9-48fe-9553-8b8c20c4faf2 None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.586539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3ab0-3fd9-48fe-9553-8b8c20c4faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.586824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3ab0-3fd9-48fe-9553-8b8c20c4faf2 None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/58fb392b863c48cb9c6ae5c209e9cac3/roles/a99210ab096549e8bebb05c3d5010884` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.589746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef3ab0-3fd9-48fe-9553-8b8c20c4faf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=58fb392b863c48cb9c6ae5c209e9cac3, role_id=a99210ab096549e8bebb05c3d5010884)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:53.592129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef3ab0-3fd9-48fe-9553-8b8c20c4faf2 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.829438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 468/954] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:43:53 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/58fb392b863c48cb9c6ae5c209e9cac3/roles/a99210ab096549e8bebb05c3d5010884 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:54.530134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d821f-48f5-4f94-94a6-f1012318bfb6 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.530717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d821f-48f5-4f94-94a6-f1012318bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.530832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d821f-48f5-4f94-94a6-f1012318bfb6 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.532595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 487/955] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:54.539605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae40bf2-2ec1-4471-8589-096abc0fc66c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.540149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae40bf2-2ec1-4471-8589-096abc0fc66c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.540149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae40bf2-2ec1-4471-8589-096abc0fc66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.558780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-bae40bf2-2ec1-4471-8589-096abc0fc66c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:54.560215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bae40bf2-2ec1-4471-8589-096abc0fc66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:54.642116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 469/956] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:54.669186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d821f-48f5-4f94-94a6-f1012318bfb6 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.771344 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:54.805742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d821f-48f5-4f94-94a6-f1012318bfb6 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:54.850766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cb73b-8bf6-4b6e-984c-da6dcc2897ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:54.851636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cb73b-8bf6-4b6e-984c-da6dcc2897ba None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.851950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cb73b-8bf6-4b6e-984c-da6dcc2897ba None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.852314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cb73b-8bf6-4b6e-984c-da6dcc2897ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.853090 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cb73b-8bf6-4b6e-984c-da6dcc2897ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:54.854552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cb73b-8bf6-4b6e-984c-da6dcc2897ba None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-6f6cb73b-8bf6-4b6e-984c-da6dcc2897ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:54.867634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:54.868778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:54.869654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:54.874672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 488/957] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:54.876243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae40bf2-2ec1-4471-8589-096abc0fc66c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.994742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae40bf2-2ec1-4471-8589-096abc0fc66c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.011340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:55.034417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8968835-3bba-4554-9d76-ff26f7ac6042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.035373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8968835-3bba-4554-9d76-ff26f7ac6042 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.035841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8968835-3bba-4554-9d76-ff26f7ac6042 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.036277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8968835-3bba-4554-9d76-ff26f7ac6042 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.037127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8968835-3bba-4554-9d76-ff26f7ac6042 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:55.037576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8968835-3bba-4554-9d76-ff26f7ac6042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.039107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8968835-3bba-4554-9d76-ff26f7ac6042 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.044832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 470/958] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:43:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:55.051427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cb73b-8bf6-4b6e-984c-da6dcc2897ba None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.188875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cb73b-8bf6-4b6e-984c-da6dcc2897ba None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.232775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1e972-237f-4dde-979c-532f4604d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.233581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1e972-237f-4dde-979c-532f4604d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.233942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1e972-237f-4dde-979c-532f4604d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.234323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1e972-237f-4dde-979c-532f4604d4f1 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.235200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1e972-237f-4dde-979c-532f4604d4f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:55.235506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1e972-237f-4dde-979c-532f4604d4f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.237049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1e972-237f-4dde-979c-532f4604d4f1 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.240347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:55.244570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 489/959] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:43:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:55.250252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8968835-3bba-4554-9d76-ff26f7ac6042 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.433767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8968835-3bba-4554-9d76-ff26f7ac6042 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.483171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef7c16-3bfd-47b0-ae06-3ffb6fb2ccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.484387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef7c16-3bfd-47b0-ae06-3ffb6fb2ccc2 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.484929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef7c16-3bfd-47b0-ae06-3ffb6fb2ccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.485388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef7c16-3bfd-47b0-ae06-3ffb6fb2ccc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.486421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef7c16-3bfd-47b0-ae06-3ffb6fb2ccc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.488031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef7c16-3bfd-47b0-ae06-3ffb6fb2ccc2 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.645673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 471/960] 10.222.0.93 () {60 vars in 1144 bytes} [Thu May 26 16:43:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:55.839051 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616bd98-bc68-449f-994a-d129977b5080 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.839642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616bd98-bc68-449f-994a-d129977b5080 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.839642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616bd98-bc68-449f-994a-d129977b5080 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.841984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 490/961] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:55.848957 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b152822-20e8-4be1-b8ad-faec78d2a6bb None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.849297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b152822-20e8-4be1-b8ad-faec78d2a6bb None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.849526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b152822-20e8-4be1-b8ad-faec78d2a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.869102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-6b152822-20e8-4be1-b8ad-faec78d2a6bb None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:55.870671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6b152822-20e8-4be1-b8ad-faec78d2a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:55.905847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:55.957282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 472/962] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:55.981242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616bd98-bc68-449f-994a-d129977b5080 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.022291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379fa9c-cda1-4941-b57e-c1fe464c5fb8 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.022619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379fa9c-cda1-4941-b57e-c1fe464c5fb8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.022848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379fa9c-cda1-4941-b57e-c1fe464c5fb8 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.024448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 473/963] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:56.032054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b30a3-352e-4b8e-b171-1a7898216e00 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.032343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b30a3-352e-4b8e-b171-1a7898216e00 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.032625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b30a3-352e-4b8e-b171-1a7898216e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.054115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-bd8b30a3-352e-4b8e-b171-1a7898216e00 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:56.055655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bd8b30a3-352e-4b8e-b171-1a7898216e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:56.133168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616bd98-bc68-449f-994a-d129977b5080 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:56.162843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 474/964] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:56.183661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f056a0-7f5b-4a66-85d3-84c4b2a76c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:56.184684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f056a0-7f5b-4a66-85d3-84c4b2a76c8b None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.185173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f056a0-7f5b-4a66-85d3-84c4b2a76c8b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.185645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f056a0-7f5b-4a66-85d3-84c4b2a76c8b None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.186564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f056a0-7f5b-4a66-85d3-84c4b2a76c8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:56.187331 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b30a3-352e-4b8e-b171-1a7898216e00 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.188643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f056a0-7f5b-4a66-85d3-84c4b2a76c8b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:56.294394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:56.305592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b30a3-352e-4b8e-b171-1a7898216e00 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:56.349678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df34e6b-f052-4d38-9eb2-f42be9fe9833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:56.350724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df34e6b-f052-4d38-9eb2-f42be9fe9833 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.351344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df34e6b-f052-4d38-9eb2-f42be9fe9833 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.351838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df34e6b-f052-4d38-9eb2-f42be9fe9833 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.352813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df34e6b-f052-4d38-9eb2-f42be9fe9833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:56.354541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df34e6b-f052-4d38-9eb2-f42be9fe9833 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:56.356196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING keystone.server.flask.common [None req-9df34e6b-f052-4d38-9eb2-f42be9fe9833 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:43:56.469161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.sql.core [None req-9df34e6b-f052-4d38-9eb2-f42be9fe9833 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:43:56.469161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:43:56.469161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [parameters: {'user_id': 'bfed93bcd88944fa9387d4ff7d6e7e89', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:43:56.469161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97428) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:43:56.479916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 491/965] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:43:55 2022] POST /identity/v3/services => generated 242 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9df34e6b-f052-4d38-9eb2-f42be9fe9833 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application conn.query(q) May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application result.read() May 26 16:43:56.480009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:43:56.480904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application next(self.gen) May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application yield resource May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application next(self.gen) May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise self.value May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application session.commit() May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:43:56.481949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.session.flush() May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application compat.raise_( May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:43:56.482967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:43:56.485771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application conn.query(q) May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application result.read() May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:43:56.488026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bfed93bcd88944fa9387d4ff7d6e7e89', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:56.490100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 16:43:56.492230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 16:43:56.495246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 16:43:56.495246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 16:43:56.495246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:43:56.495246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:43:56.495246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:43:56.495246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:56.495246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 475/966] 10.222.0.93 () {60 vars in 1131 bytes} [Thu May 26 16:43:56 2022] POST /identity/v3/users => generated 160 bytes in 307 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:56.503159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f056a0-7f5b-4a66-85d3-84c4b2a76c8b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.588268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42144db-7d2b-47a6-a8d0-70a09b73a900 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.588680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42144db-7d2b-47a6-a8d0-70a09b73a900 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.589146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:56.589658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42144db-7d2b-47a6-a8d0-70a09b73a900 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.597080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 476/967] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:56.602684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2f41-48d3-4faf-8d19-244818c74e6c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.629010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2f41-48d3-4faf-8d19-244818c74e6c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.629010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2f41-48d3-4faf-8d19-244818c74e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.629010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8f0a2f41-48d3-4faf-8d19-244818c74e6c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:56.629010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8f0a2f41-48d3-4faf-8d19-244818c74e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:56.662776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f056a0-7f5b-4a66-85d3-84c4b2a76c8b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:56.722762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2fff6-2b8c-4919-9653-411761981d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:56.723478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2fff6-2b8c-4919-9653-411761981d60 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:56.724760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2fff6-2b8c-4919-9653-411761981d60 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:56.725061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2fff6-2b8c-4919-9653-411761981d60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:56.733737 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 477/968] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:56.737538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2fff6-2b8c-4919-9653-411761981d60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:56.739056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2fff6-2b8c-4919-9653-411761981d60 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:56.759445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2f41-48d3-4faf-8d19-244818c74e6c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-c0a2fff6-2b8c-4919-9653-411761981d60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:56.759761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:56.761131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:56.762726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 492/969] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:43:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:56.770135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2fff6-2b8c-4919-9653-411761981d60 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:56.932274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:56.952036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2fff6-2b8c-4919-9653-411761981d60 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:56.965250 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2f41-48d3-4faf-8d19-244818c74e6c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.003120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:57.003120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d788e9-4af1-45dc-8a4d-1e3cf12b2b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.003120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d788e9-4af1-45dc-8a4d-1e3cf12b2b29 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.003120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d788e9-4af1-45dc-8a4d-1e3cf12b2b29 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.003614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d788e9-4af1-45dc-8a4d-1e3cf12b2b29 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.003614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d788e9-4af1-45dc-8a4d-1e3cf12b2b29 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:57.003614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d788e9-4af1-45dc-8a4d-1e3cf12b2b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.003614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d788e9-4af1-45dc-8a4d-1e3cf12b2b29 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.012213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464691f-3c79-403f-bbc5-1455d67ba07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.013115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464691f-3c79-403f-bbc5-1455d67ba07d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.013541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464691f-3c79-403f-bbc5-1455d67ba07d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.013929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464691f-3c79-403f-bbc5-1455d67ba07d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.027033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464691f-3c79-403f-bbc5-1455d67ba07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-f464691f-3c79-403f-bbc5-1455d67ba07d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:43:57.038148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:57.039340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:43:57.040395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:57.042304 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 478/970] 10.222.0.93 () {56 vars in 1120 bytes} [Thu May 26 16:43:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:43:57.051083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464691f-3c79-403f-bbc5-1455d67ba07d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.051913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 493/971] 10.222.0.93 () {56 vars in 1101 bytes} [Thu May 26 16:43:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:57.175143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464691f-3c79-403f-bbc5-1455d67ba07d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.216687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75051a-1272-4994-abec-bac44b6ab016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.217645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75051a-1272-4994-abec-bac44b6ab016 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.218117 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75051a-1272-4994-abec-bac44b6ab016 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.218407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75051a-1272-4994-abec-bac44b6ab016 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.219190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75051a-1272-4994-abec-bac44b6ab016 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:57.219505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75051a-1272-4994-abec-bac44b6ab016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.221150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75051a-1272-4994-abec-bac44b6ab016 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.232339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 479/972] 10.222.0.93 () {56 vars in 1115 bytes} [Thu May 26 16:43:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:57.238440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d788e9-4af1-45dc-8a4d-1e3cf12b2b29 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.365845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d788e9-4af1-45dc-8a4d-1e3cf12b2b29 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.402360 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb85b1-2137-4cb1-92ea-0ab27ed0f64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.403758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb85b1-2137-4cb1-92ea-0ab27ed0f64e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.404043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb85b1-2137-4cb1-92ea-0ab27ed0f64e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.404318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb85b1-2137-4cb1-92ea-0ab27ed0f64e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.415960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb85b1-2137-4cb1-92ea-0ab27ed0f64e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.417433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb85b1-2137-4cb1-92ea-0ab27ed0f64e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-48fb85b1-2137-4cb1-92ea-0ab27ed0f64e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:57.436503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:57.437657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:57.439421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:57.439421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:57.439421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:57.439421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:57.439421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 494/973] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:57.443700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75051a-1272-4994-abec-bac44b6ab016 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.447523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:57.547464 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75051a-1272-4994-abec-bac44b6ab016 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.583921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21fa6c-3262-40d3-9ed4-c50246cc7156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.584731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21fa6c-3262-40d3-9ed4-c50246cc7156 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.585113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21fa6c-3262-40d3-9ed4-c50246cc7156 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.585484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21fa6c-3262-40d3-9ed4-c50246cc7156 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.586301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21fa6c-3262-40d3-9ed4-c50246cc7156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:57.586704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21fa6c-3262-40d3-9ed4-c50246cc7156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.588220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21fa6c-3262-40d3-9ed4-c50246cc7156 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.606883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 480/974] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:57.608305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb85b1-2137-4cb1-92ea-0ab27ed0f64e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.639892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:57.729958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb85b1-2137-4cb1-92ea-0ab27ed0f64e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.768255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff33f0-ba70-4148-a6e4-8f5be2f1649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.769071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff33f0-ba70-4148-a6e4-8f5be2f1649c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.769354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff33f0-ba70-4148-a6e4-8f5be2f1649c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.769630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff33f0-ba70-4148-a6e4-8f5be2f1649c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.776908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff33f0-ba70-4148-a6e4-8f5be2f1649c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.778405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff33f0-ba70-4148-a6e4-8f5be2f1649c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-42ff33f0-ba70-4148-a6e4-8f5be2f1649c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:43:57.795665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:57.796736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:57.798794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 495/975] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:43:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:57.802592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21fa6c-3262-40d3-9ed4-c50246cc7156 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:57.868596 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:57.906904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21fa6c-3262-40d3-9ed4-c50246cc7156 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:57.941983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a3837-a9d1-4cae-b499-69be47c4dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:57.942652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a3837-a9d1-4cae-b499-69be47c4dc77 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:57.942930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a3837-a9d1-4cae-b499-69be47c4dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:57.943202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a3837-a9d1-4cae-b499-69be47c4dc77 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:57.944100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a3837-a9d1-4cae-b499-69be47c4dc77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:57.944504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a3837-a9d1-4cae-b499-69be47c4dc77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:57.946110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a3837-a9d1-4cae-b499-69be47c4dc77 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:57.964400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 481/976] 10.222.0.93 () {56 vars in 1149 bytes} [Thu May 26 16:43:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:57.971277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff33f0-ba70-4148-a6e4-8f5be2f1649c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.070606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.087211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff33f0-ba70-4148-a6e4-8f5be2f1649c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.121282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feea3b-67be-4bd2-89b4-140c6531a3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.122471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feea3b-67be-4bd2-89b4-140c6531a3e8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.122755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feea3b-67be-4bd2-89b4-140c6531a3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.123032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feea3b-67be-4bd2-89b4-140c6531a3e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.195169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feea3b-67be-4bd2-89b4-140c6531a3e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.196688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feea3b-67be-4bd2-89b4-140c6531a3e8 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.207223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac95d-9a54-4798-9340-0c189285478a None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.207601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac95d-9a54-4798-9340-0c189285478a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.207825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac95d-9a54-4798-9340-0c189285478a None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.211896 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 482/977] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:43:58.214256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c2088-6e73-4831-a3ab-7a6a8706c423 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.214547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c2088-6e73-4831-a3ab-7a6a8706c423 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.214838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c2088-6e73-4831-a3ab-7a6a8706c423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.232046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8b2c2088-6e73-4831-a3ab-7a6a8706c423 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:58.233207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8b2c2088-6e73-4831-a3ab-7a6a8706c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:58.296350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.310175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 483/978] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:43:58.315884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 496/979] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:43:57 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:43:58.319444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c2088-6e73-4831-a3ab-7a6a8706c423 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.333119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feea3b-67be-4bd2-89b4-140c6531a3e8 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.379192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.431099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c2088-6e73-4831-a3ab-7a6a8706c423 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.441050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feea3b-67be-4bd2-89b4-140c6531a3e8 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.476283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48aba7-15d7-42f5-bf9a-adafd7ee8358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.477230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f1af-0233-46cb-8273-2a855b9032dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.477535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48aba7-15d7-42f5-bf9a-adafd7ee8358 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.477979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48aba7-15d7-42f5-bf9a-adafd7ee8358 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.478103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f1af-0233-46cb-8273-2a855b9032dc None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.478301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f1af-0233-46cb-8273-2a855b9032dc None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.478609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f1af-0233-46cb-8273-2a855b9032dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.478814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48aba7-15d7-42f5-bf9a-adafd7ee8358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.479267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24f1af-0233-46cb-8273-2a855b9032dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.480670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24f1af-0233-46cb-8273-2a855b9032dc None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.491843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48aba7-15d7-42f5-bf9a-adafd7ee8358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.493522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48aba7-15d7-42f5-bf9a-adafd7ee8358 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-9e24f1af-0233-46cb-8273-2a855b9032dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:58.493949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:58.495165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:43:58.497355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 497/980] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:58.501761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f1af-0233-46cb-8273-2a855b9032dc None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-6a48aba7-15d7-42f5-bf9a-adafd7ee8358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:43:58.524070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:58.525095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:58.531199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:43:58.531199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:43:58.531199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:43:58.531199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:58.531199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 484/981] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:58.531951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48aba7-15d7-42f5-bf9a-adafd7ee8358 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.553153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.611494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f1af-0233-46cb-8273-2a855b9032dc None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.647591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23769b7-32ec-497f-b27f-5565f690ba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.648441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23769b7-32ec-497f-b27f-5565f690ba6f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.648818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23769b7-32ec-497f-b27f-5565f690ba6f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.649220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23769b7-32ec-497f-b27f-5565f690ba6f None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.649903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23769b7-32ec-497f-b27f-5565f690ba6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:58.650208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23769b7-32ec-497f-b27f-5565f690ba6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.651252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48aba7-15d7-42f5-bf9a-adafd7ee8358 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.651619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23769b7-32ec-497f-b27f-5565f690ba6f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.655902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.657980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 498/982] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:58.664325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23769b7-32ec-497f-b27f-5565f690ba6f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.703053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd70f-297d-4650-bb2f-4d738ef0cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.704440 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd70f-297d-4650-bb2f-4d738ef0cea5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.704720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd70f-297d-4650-bb2f-4d738ef0cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.705004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd70f-297d-4650-bb2f-4d738ef0cea5 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.705780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cd70f-297d-4650-bb2f-4d738ef0cea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:58.706105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cd70f-297d-4650-bb2f-4d738ef0cea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.707543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cd70f-297d-4650-bb2f-4d738ef0cea5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.721523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 485/983] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:58.727085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd70f-297d-4650-bb2f-4d738ef0cea5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.795552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23769b7-32ec-497f-b27f-5565f690ba6f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.811280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.832284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55890-eeb6-48b6-b73b-1574015b81de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.832955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55890-eeb6-48b6-b73b-1574015b81de None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.833241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55890-eeb6-48b6-b73b-1574015b81de None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.833525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55890-eeb6-48b6-b73b-1574015b81de None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.834240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a55890-eeb6-48b6-b73b-1574015b81de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:58.834547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a55890-eeb6-48b6-b73b-1574015b81de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.835990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a55890-eeb6-48b6-b73b-1574015b81de None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.837477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd70f-297d-4650-bb2f-4d738ef0cea5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.842056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 499/984] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:58.847938 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55890-eeb6-48b6-b73b-1574015b81de None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.878614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56439534-88f4-418c-874c-1712879299dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.879406 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56439534-88f4-418c-874c-1712879299dc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.879735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56439534-88f4-418c-874c-1712879299dc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.880018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56439534-88f4-418c-874c-1712879299dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.887005 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56439534-88f4-418c-874c-1712879299dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.888522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56439534-88f4-418c-874c-1712879299dc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-56439534-88f4-418c-874c-1712879299dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:43:58.902657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:58.904530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:58.905862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:43:58.905862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:43:58.905862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:43:58.905862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:43:58.905862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:43:58.905862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:43:58.905862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:43:58.905862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:58.906620 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 486/985] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:58.908141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920fb49-7fb2-46bf-a19c-2537bd7e0841 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.908434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920fb49-7fb2-46bf-a19c-2537bd7e0841 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.908720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920fb49-7fb2-46bf-a19c-2537bd7e0841 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.910276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 487/986] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:58.910988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920fb49-7fb2-46bf-a19c-2537bd7e0841 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:58.937350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:58.954200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55890-eeb6-48b6-b73b-1574015b81de None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:58.989944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092448f-82f7-430e-8e6d-9aa10ac8fef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:58.990621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092448f-82f7-430e-8e6d-9aa10ac8fef5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:58.990936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092448f-82f7-430e-8e6d-9aa10ac8fef5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:58.991228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092448f-82f7-430e-8e6d-9aa10ac8fef5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:58.992090 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092448f-82f7-430e-8e6d-9aa10ac8fef5 None admin] RBAC: Adding query filter params (interface=admin, service_id=69c6a89bd8f0479e8c2279840c38a5d7, region_id=RegionOne) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:58.992404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092448f-82f7-430e-8e6d-9aa10ac8fef5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:58.993852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092448f-82f7-430e-8e6d-9aa10ac8fef5 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:58.999482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 500/987] 10.222.0.93 () {56 vars in 1249 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/endpoints?service_id=69c6a89bd8f0479e8c2279840c38a5d7&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:59.001026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0e64-328e-48c2-9a88-49ebcbe07792 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.001656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0e64-328e-48c2-9a88-49ebcbe07792 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.001656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0e64-328e-48c2-9a88-49ebcbe07792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.018569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920fb49-7fb2-46bf-a19c-2537bd7e0841 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.021958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-2e6c0e64-328e-48c2-9a88-49ebcbe07792 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:59.023524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2e6c0e64-328e-48c2-9a88-49ebcbe07792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.061448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261b6bc-1c94-4603-81d7-7cc8275577d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.062114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261b6bc-1c94-4603-81d7-7cc8275577d3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.062398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261b6bc-1c94-4603-81d7-7cc8275577d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.062681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261b6bc-1c94-4603-81d7-7cc8275577d3 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.063470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261b6bc-1c94-4603-81d7-7cc8275577d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:59.063812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261b6bc-1c94-4603-81d7-7cc8275577d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.065255 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261b6bc-1c94-4603-81d7-7cc8275577d3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.067327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.078458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 488/988] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:59.079383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261b6bc-1c94-4603-81d7-7cc8275577d3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.102256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 501/989] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:43:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:43:59.103100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c0e64-328e-48c2-9a88-49ebcbe07792 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.172721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.189190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261b6bc-1c94-4603-81d7-7cc8275577d3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.208332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c0e64-328e-48c2-9a88-49ebcbe07792 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.229634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dfe84-8481-4580-848b-197ddcbf34a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.230393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dfe84-8481-4580-848b-197ddcbf34a3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.230681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dfe84-8481-4580-848b-197ddcbf34a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.231073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dfe84-8481-4580-848b-197ddcbf34a3 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.231801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dfe84-8481-4580-848b-197ddcbf34a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.233277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dfe84-8481-4580-848b-197ddcbf34a3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.240157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 489/990] 10.222.0.93 () {56 vars in 1087 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:59.240874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dfe84-8481-4580-848b-197ddcbf34a3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.250111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a39a-3b81-4c7e-a7d1-7a3a2d7e19f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.251491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a39a-3b81-4c7e-a7d1-7a3a2d7e19f8 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.251785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a39a-3b81-4c7e-a7d1-7a3a2d7e19f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.252251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a39a-3b81-4c7e-a7d1-7a3a2d7e19f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.253886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63a39a-3b81-4c7e-a7d1-7a3a2d7e19f8 None admin] RBAC: Adding query filter params (role.id=a99210ab096549e8bebb05c3d5010884, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=58fb392b863c48cb9c6ae5c209e9cac3) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:59.254145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63a39a-3b81-4c7e-a7d1-7a3a2d7e19f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.257037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63a39a-3b81-4c7e-a7d1-7a3a2d7e19f8 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.283596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 502/991] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/role_assignments?user.id=58fb392b863c48cb9c6ae5c209e9cac3&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a99210ab096549e8bebb05c3d5010884 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:59.388687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dfe84-8481-4580-848b-197ddcbf34a3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.433145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165d95-f7aa-4e49-acac-6bfda0876d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.434485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165d95-f7aa-4e49-acac-6bfda0876d16 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.434773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165d95-f7aa-4e49-acac-6bfda0876d16 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.435047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165d95-f7aa-4e49-acac-6bfda0876d16 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.435777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa165d95-f7aa-4e49-acac-6bfda0876d16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.437397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa165d95-f7aa-4e49-acac-6bfda0876d16 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-aa165d95-f7aa-4e49-acac-6bfda0876d16 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:43:59.450856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:43:59.452276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:43:59.455520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 490/992] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:43:59.458426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a39a-3b81-4c7e-a7d1-7a3a2d7e19f8 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.504835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.589176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a39a-3b81-4c7e-a7d1-7a3a2d7e19f8 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.626230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bbfbb-44fc-4ce7-a618-8718ff4a6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.626895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bbfbb-44fc-4ce7-a618-8718ff4a6131 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.627173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bbfbb-44fc-4ce7-a618-8718ff4a6131 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.627451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bbfbb-44fc-4ce7-a618-8718ff4a6131 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.628213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bbfbb-44fc-4ce7-a618-8718ff4a6131 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:59.628516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bbfbb-44fc-4ce7-a618-8718ff4a6131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.629887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bbfbb-44fc-4ce7-a618-8718ff4a6131 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.635502 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 503/993] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:59.642143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165d95-f7aa-4e49-acac-6bfda0876d16 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.658473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.759553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165d95-f7aa-4e49-acac-6bfda0876d16 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.799131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd382e88-b0cb-41e9-b2e8-8c31f09fdbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.800145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd382e88-b0cb-41e9-b2e8-8c31f09fdbfa None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.800571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd382e88-b0cb-41e9-b2e8-8c31f09fdbfa None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.801016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd382e88-b0cb-41e9-b2e8-8c31f09fdbfa None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.801876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd382e88-b0cb-41e9-b2e8-8c31f09fdbfa None admin] RBAC: Adding query filter params (type=compute) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:59.802324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd382e88-b0cb-41e9-b2e8-8c31f09fdbfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.803907 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd382e88-b0cb-41e9-b2e8-8c31f09fdbfa None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.810825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 491/994] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:59.816770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bbfbb-44fc-4ce7-a618-8718ff4a6131 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.933568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.937743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bbfbb-44fc-4ce7-a618-8718ff4a6131 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.972789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d1885-37d4-4347-b4fa-6ca0eb9ca8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.973646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d1885-37d4-4347-b4fa-6ca0eb9ca8b3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.973781 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d1885-37d4-4347-b4fa-6ca0eb9ca8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.974141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d1885-37d4-4347-b4fa-6ca0eb9ca8b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.974884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d1885-37d4-4347-b4fa-6ca0eb9ca8b3 None admin] RBAC: Adding query filter params (interface=public, service_id=74ea221eee984d36ae88892ed3266d76, region_id=RegionOne) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:59.975192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d1885-37d4-4347-b4fa-6ca0eb9ca8b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.976621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d1885-37d4-4347-b4fa-6ca0eb9ca8b3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.987321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 504/995] 10.222.0.93 () {56 vars in 1251 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/endpoints?service_id=74ea221eee984d36ae88892ed3266d76&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:59.988726 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd382e88-b0cb-41e9-b2e8-8c31f09fdbfa None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:00.081917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:00.107687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd382e88-b0cb-41e9-b2e8-8c31f09fdbfa None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:00.149350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc13fc-7716-43d6-8289-b4939f673a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:00.150031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc13fc-7716-43d6-8289-b4939f673a19 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.150332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc13fc-7716-43d6-8289-b4939f673a19 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.150607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc13fc-7716-43d6-8289-b4939f673a19 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.151285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc13fc-7716-43d6-8289-b4939f673a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:00.153348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc13fc-7716-43d6-8289-b4939f673a19 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:00.165494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 492/996] 10.222.0.93 () {56 vars in 1087 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:01.534239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9d8a-5c96-484a-87ec-7bbcf80b45f6 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.534771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9d8a-5c96-484a-87ec-7bbcf80b45f6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.534850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9d8a-5c96-484a-87ec-7bbcf80b45f6 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.536391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 505/997] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:01.541661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68ea6d-5deb-4ec1-80ba-56c83857ea36 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.542113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68ea6d-5deb-4ec1-80ba-56c83857ea36 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.542298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68ea6d-5deb-4ec1-80ba-56c83857ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.559689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5d68ea6d-5deb-4ec1-80ba-56c83857ea36 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:01.560875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5d68ea6d-5deb-4ec1-80ba-56c83857ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:01.575097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf6b1-6f2a-42ec-b2d5-0a340b1f2e8d None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.575434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf6b1-6f2a-42ec-b2d5-0a340b1f2e8d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.575694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf6b1-6f2a-42ec-b2d5-0a340b1f2e8d None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.577079 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 506/998] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:44:01.582432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c15be-c68a-44f5-9f11-80adb350f126 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.582718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c15be-c68a-44f5-9f11-80adb350f126 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.582998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c15be-c68a-44f5-9f11-80adb350f126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.600149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-077c15be-c68a-44f5-9f11-80adb350f126 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:01.601425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-077c15be-c68a-44f5-9f11-80adb350f126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:01.634884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 493/999] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:01.657889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68ea6d-5deb-4ec1-80ba-56c83857ea36 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.681894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 507/1000] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:44:01.700436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c15be-c68a-44f5-9f11-80adb350f126 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.739087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:01.771262 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68ea6d-5deb-4ec1-80ba-56c83857ea36 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.806838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:01.809727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0a3fd-ae44-4238-87dd-392c2f29d4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.810538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0a3fd-ae44-4238-87dd-392c2f29d4c5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.811057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0a3fd-ae44-4238-87dd-392c2f29d4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.811172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0a3fd-ae44-4238-87dd-392c2f29d4c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.811912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0a3fd-ae44-4238-87dd-392c2f29d4c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.813294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0a3fd-ae44-4238-87dd-392c2f29d4c5 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.814251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c15be-c68a-44f5-9f11-80adb350f126 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-2da0a3fd-ae44-4238-87dd-392c2f29d4c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:01.825557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:01.833450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:01.834487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 494/1001] 10.222.0.93 () {56 vars in 1126 bytes} [Thu May 26 16:44:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:44:01.835506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0a3fd-ae44-4238-87dd-392c2f29d4c5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.853822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5db58-2996-473e-8325-eed58e97441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.854620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5db58-2996-473e-8325-eed58e97441c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.854905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5db58-2996-473e-8325-eed58e97441c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.855182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5db58-2996-473e-8325-eed58e97441c None admin] PATH_INFO: `/v3/services/image` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.856519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5db58-2996-473e-8325-eed58e97441c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.858124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5db58-2996-473e-8325-eed58e97441c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-f3a5db58-2996-473e-8325-eed58e97441c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:01.870516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:01.871854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:44:01.873001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:01.877743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 508/1002] 10.222.0.93 () {56 vars in 1105 bytes} [Thu May 26 16:44:01 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:01.884228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5db58-2996-473e-8325-eed58e97441c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.951865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0a3fd-ae44-4238-87dd-392c2f29d4c5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.992065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5db58-2996-473e-8325-eed58e97441c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.992380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e906550-5f53-46a1-9961-08786ce442bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.993212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e906550-5f53-46a1-9961-08786ce442bb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.993644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e906550-5f53-46a1-9961-08786ce442bb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.994096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e906550-5f53-46a1-9961-08786ce442bb None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.994967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e906550-5f53-46a1-9961-08786ce442bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:01.995274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e906550-5f53-46a1-9961-08786ce442bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.996716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e906550-5f53-46a1-9961-08786ce442bb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.997979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:02.003101 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 495/1003] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:44:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:02.009474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e906550-5f53-46a1-9961-08786ce442bb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.039991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225e7ba-f145-475b-8836-eaddae33260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.040938 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e7ba-f145-475b-8836-eaddae33260b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.041229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e7ba-f145-475b-8836-eaddae33260b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.043907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e7ba-f145-475b-8836-eaddae33260b None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.043907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225e7ba-f145-475b-8836-eaddae33260b None admin] RBAC: Adding query filter params (name=image) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:02.043907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225e7ba-f145-475b-8836-eaddae33260b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.045100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225e7ba-f145-475b-8836-eaddae33260b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.057503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 509/1004] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:02.058950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225e7ba-f145-475b-8836-eaddae33260b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.097744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:02.126655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e906550-5f53-46a1-9961-08786ce442bb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.172761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ee2d1-8ee7-49a5-8e33-1e0a25fe0065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.173543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee2d1-8ee7-49a5-8e33-1e0a25fe0065 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.173948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee2d1-8ee7-49a5-8e33-1e0a25fe0065 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.174344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee2d1-8ee7-49a5-8e33-1e0a25fe0065 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.175457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ee2d1-8ee7-49a5-8e33-1e0a25fe0065 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:02.175939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ee2d1-8ee7-49a5-8e33-1e0a25fe0065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.177295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ee2d1-8ee7-49a5-8e33-1e0a25fe0065 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.184010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 496/1005] 10.222.0.93 () {56 vars in 1122 bytes} [Thu May 26 16:44:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:02.190433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ee2d1-8ee7-49a5-8e33-1e0a25fe0065 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.197371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225e7ba-f145-475b-8836-eaddae33260b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.241672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b74d2-863b-4914-94d0-3ab20472a742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.242718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b74d2-863b-4914-94d0-3ab20472a742 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.243184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b74d2-863b-4914-94d0-3ab20472a742 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.243469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b74d2-863b-4914-94d0-3ab20472a742 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.244239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b74d2-863b-4914-94d0-3ab20472a742 None admin] RBAC: Adding query filter params (type=image) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:02.244550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b74d2-863b-4914-94d0-3ab20472a742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.245922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b74d2-863b-4914-94d0-3ab20472a742 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.251321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 510/1006] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:02.274083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:02.318249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ee2d1-8ee7-49a5-8e33-1e0a25fe0065 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.358343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e113a42-f0d3-4f40-a282-053589d10b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.359092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e113a42-f0d3-4f40-a282-053589d10b5a None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.359378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e113a42-f0d3-4f40-a282-053589d10b5a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.359772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e113a42-f0d3-4f40-a282-053589d10b5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.360565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e113a42-f0d3-4f40-a282-053589d10b5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.361996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e113a42-f0d3-4f40-a282-053589d10b5a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.412004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff74d7-f964-484e-af91-989222d33efc None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.412300 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff74d7-f964-484e-af91-989222d33efc None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.412624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff74d7-f964-484e-af91-989222d33efc None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.414052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 511/1007] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:44:02.419956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866cf1e-db42-42ff-9fb6-44692c12166c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.420247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866cf1e-db42-42ff-9fb6-44692c12166c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.420528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866cf1e-db42-42ff-9fb6-44692c12166c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.438751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d866cf1e-db42-42ff-9fb6-44692c12166c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:02.440056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d866cf1e-db42-42ff-9fb6-44692c12166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:02.514462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 512/1008] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:44:02.528118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 497/1009] 10.222.0.93 () {60 vars in 1144 bytes} [Thu May 26 16:44:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:02.538207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866cf1e-db42-42ff-9fb6-44692c12166c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.558266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:02.654357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866cf1e-db42-42ff-9fb6-44692c12166c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.706311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd31e-1651-45df-bb94-7cdfb8390c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.707122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd31e-1651-45df-bb94-7cdfb8390c46 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.707406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd31e-1651-45df-bb94-7cdfb8390c46 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.707717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd31e-1651-45df-bb94-7cdfb8390c46 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.708374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd31e-1651-45df-bb94-7cdfb8390c46 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.709762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd31e-1651-45df-bb94-7cdfb8390c46 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-899fd31e-1651-45df-bb94-7cdfb8390c46 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:02.722857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:02.724002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:02.724907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 513/1010] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:44:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:02.731064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e113a42-f0d3-4f40-a282-053589d10b5a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.841627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e113a42-f0d3-4f40-a282-053589d10b5a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.865691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:02.878686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc1203-2722-41de-9900-fffe356d8f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.879353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc1203-2722-41de-9900-fffe356d8f6b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.881249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc1203-2722-41de-9900-fffe356d8f6b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.881249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc1203-2722-41de-9900-fffe356d8f6b None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.881249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc1203-2722-41de-9900-fffe356d8f6b None admin] RBAC: Adding query filter params (name=compute) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:02.881249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc1203-2722-41de-9900-fffe356d8f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.882388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc1203-2722-41de-9900-fffe356d8f6b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.887649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 498/1011] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:44:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:02.893446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd31e-1651-45df-bb94-7cdfb8390c46 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.981494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:03.005119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd31e-1651-45df-bb94-7cdfb8390c46 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:03.040235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2c3cb-3b34-49f4-ae71-18c6663fd9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:03.040902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2c3cb-3b34-49f4-ae71-18c6663fd9d3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.041186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2c3cb-3b34-49f4-ae71-18c6663fd9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.041465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2c3cb-3b34-49f4-ae71-18c6663fd9d3 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.042172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2c3cb-3b34-49f4-ae71-18c6663fd9d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:03.042481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2c3cb-3b34-49f4-ae71-18c6663fd9d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:03.044424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2c3cb-3b34-49f4-ae71-18c6663fd9d3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:03.054530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 514/1012] 10.222.0.93 () {56 vars in 1112 bytes} [Thu May 26 16:44:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:03.055959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc1203-2722-41de-9900-fffe356d8f6b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:03.173342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc1203-2722-41de-9900-fffe356d8f6b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:03.210649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78168cbd-e59e-40db-a6ba-85c429653408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:03.211166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168cbd-e59e-40db-a6ba-85c429653408 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.211446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168cbd-e59e-40db-a6ba-85c429653408 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.211751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168cbd-e59e-40db-a6ba-85c429653408 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.212494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78168cbd-e59e-40db-a6ba-85c429653408 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:03.213960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78168cbd-e59e-40db-a6ba-85c429653408 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:03.379783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 499/1013] 10.222.0.93 () {60 vars in 1144 bytes} [Thu May 26 16:44:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:04.523299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf57a8-fb99-477a-bec8-1c132656f41e None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.523892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf57a8-fb99-477a-bec8-1c132656f41e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.523892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf57a8-fb99-477a-bec8-1c132656f41e None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.525390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 515/1014] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:04.530479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6c8ff-b416-4c03-88c2-d92a441b05b6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.530933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6c8ff-b416-4c03-88c2-d92a441b05b6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.531010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6c8ff-b416-4c03-88c2-d92a441b05b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.548600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-bfe6c8ff-b416-4c03-88c2-d92a441b05b6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:04.549782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bfe6c8ff-b416-4c03-88c2-d92a441b05b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.588810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:04.632358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 500/1015] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:04.657567 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf57a8-fb99-477a-bec8-1c132656f41e None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.771214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf57a8-fb99-477a-bec8-1c132656f41e None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.806103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388c07-29f1-4c57-b0fd-9e653686faf1 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.806306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388c07-29f1-4c57-b0fd-9e653686faf1 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.806567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388c07-29f1-4c57-b0fd-9e653686faf1 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.808007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 501/1016] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:44:04.813610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61f83a-aef9-4c7f-8876-5e0936d4cfe2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.813902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61f83a-aef9-4c7f-8876-5e0936d4cfe2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.814180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61f83a-aef9-4c7f-8876-5e0936d4cfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.822664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba1495-b97d-439a-a8d6-d04be0370efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.823363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba1495-b97d-439a-a8d6-d04be0370efe None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.823647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba1495-b97d-439a-a8d6-d04be0370efe None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.823925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba1495-b97d-439a-a8d6-d04be0370efe None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.824691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba1495-b97d-439a-a8d6-d04be0370efe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.826579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba1495-b97d-439a-a8d6-d04be0370efe None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.831665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ae61f83a-aef9-4c7f-8876-5e0936d4cfe2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:04.832882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ae61f83a-aef9-4c7f-8876-5e0936d4cfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.906973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 502/1017] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:04.933065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61f83a-aef9-4c7f-8876-5e0936d4cfe2 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.934091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:04.943624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 516/1018] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/services => generated 242 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:05.079137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:05.084608 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61f83a-aef9-4c7f-8876-5e0936d4cfe2 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.136831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08e7e1-8b86-4927-96ff-0e90817075e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.138196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08e7e1-8b86-4927-96ff-0e90817075e4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.138480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08e7e1-8b86-4927-96ff-0e90817075e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.138755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08e7e1-8b86-4927-96ff-0e90817075e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.140819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08e7e1-8b86-4927-96ff-0e90817075e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.142346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08e7e1-8b86-4927-96ff-0e90817075e4 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.144443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 503/1019] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:05.150273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba1495-b97d-439a-a8d6-d04be0370efe None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.298748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba1495-b97d-439a-a8d6-d04be0370efe None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.339285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732f02a-c6c0-4b31-a2f7-9abbec923d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.339909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f02a-c6c0-4b31-a2f7-9abbec923d1d None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.340787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f02a-c6c0-4b31-a2f7-9abbec923d1d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.341148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f02a-c6c0-4b31-a2f7-9abbec923d1d None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.341912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732f02a-c6c0-4b31-a2f7-9abbec923d1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.343649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732f02a-c6c0-4b31-a2f7-9abbec923d1d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.450250 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 517/1020] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:44:05 2022] POST /identity/v3/projects => generated 311 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:05.786686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767f8b-a8b3-4741-8c50-bb2ed7a5ba0e None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.787248 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767f8b-a8b3-4741-8c50-bb2ed7a5ba0e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.787248 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767f8b-a8b3-4741-8c50-bb2ed7a5ba0e None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.788859 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 504/1021] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:44:05.794834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bef7e-53e8-4d39-b405-e869def3bb64 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.795344 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bef7e-53e8-4d39-b405-e869def3bb64 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.795431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bef7e-53e8-4d39-b405-e869def3bb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.812268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-957bef7e-53e8-4d39-b405-e869def3bb64 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:05.813519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-957bef7e-53e8-4d39-b405-e869def3bb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.866483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:05.888205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 518/1022] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:05.911364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767f8b-a8b3-4741-8c50-bb2ed7a5ba0e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.032954 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767f8b-a8b3-4741-8c50-bb2ed7a5ba0e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:06.078416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c4bfc-b53b-480b-94f9-11cec3400a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:06.079754 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c4bfc-b53b-480b-94f9-11cec3400a8a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.080242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c4bfc-b53b-480b-94f9-11cec3400a8a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.080728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c4bfc-b53b-480b-94f9-11cec3400a8a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.096788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c4bfc-b53b-480b-94f9-11cec3400a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-f71c4bfc-b53b-480b-94f9-11cec3400a8a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:44:06.105059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:06.106245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:44:06.107184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:06.111687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 505/1023] 10.222.0.93 () {56 vars in 1120 bytes} [Thu May 26 16:44:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:06.112406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bef7e-53e8-4d39-b405-e869def3bb64 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.233298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bef7e-53e8-4d39-b405-e869def3bb64 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:06.270560 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5525d5f-7acc-4684-9d7c-cab053171993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:06.271232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525d5f-7acc-4684-9d7c-cab053171993 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.271514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525d5f-7acc-4684-9d7c-cab053171993 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.271810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525d5f-7acc-4684-9d7c-cab053171993 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.272565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525d5f-7acc-4684-9d7c-cab053171993 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:06.272871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525d5f-7acc-4684-9d7c-cab053171993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:06.274240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525d5f-7acc-4684-9d7c-cab053171993 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:06.284112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 519/1024] 10.222.0.93 () {56 vars in 1115 bytes} [Thu May 26 16:44:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:06.289558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c4bfc-b53b-480b-94f9-11cec3400a8a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.319953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:06.414931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c4bfc-b53b-480b-94f9-11cec3400a8a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:06.453155 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73096-ec08-46a3-bfaa-05ca9c7a6129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:06.453955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73096-ec08-46a3-bfaa-05ca9c7a6129 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.454228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73096-ec08-46a3-bfaa-05ca9c7a6129 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.454505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73096-ec08-46a3-bfaa-05ca9c7a6129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.466084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be73096-ec08-46a3-bfaa-05ca9c7a6129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:06.467835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be73096-ec08-46a3-bfaa-05ca9c7a6129 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-6be73096-ec08-46a3-bfaa-05ca9c7a6129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:44:06.486540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:06.488015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:06.489367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:44:06.489367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:44:06.489367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:06.489367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:06.492080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 506/1025] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:06.494212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5525d5f-7acc-4684-9d7c-cab053171993 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.544744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:06.601397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5525d5f-7acc-4684-9d7c-cab053171993 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:06.664454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e48b6-2d8f-4227-82b8-aa4ca49e0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:06.665981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e48b6-2d8f-4227-82b8-aa4ca49e0fdf None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.666721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e48b6-2d8f-4227-82b8-aa4ca49e0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.667430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e48b6-2d8f-4227-82b8-aa4ca49e0fdf None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.669514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e48b6-2d8f-4227-82b8-aa4ca49e0fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:06.670382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e48b6-2d8f-4227-82b8-aa4ca49e0fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:06.673207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e48b6-2d8f-4227-82b8-aa4ca49e0fdf None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:06.692598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 520/1026] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:06.701793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73096-ec08-46a3-bfaa-05ca9c7a6129 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.787927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:06.817843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73096-ec08-46a3-bfaa-05ca9c7a6129 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:06.854675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645c731-e245-4e8e-9c9f-b840bc7728e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:06.855465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645c731-e245-4e8e-9c9f-b840bc7728e2 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.856299 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645c731-e245-4e8e-9c9f-b840bc7728e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.856573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645c731-e245-4e8e-9c9f-b840bc7728e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.865321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645c731-e245-4e8e-9c9f-b840bc7728e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:06.866782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645c731-e245-4e8e-9c9f-b840bc7728e2 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-e645c731-e245-4e8e-9c9f-b840bc7728e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:44:06.882176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:06.883518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:06.889980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 507/1027] 10.222.0.93 () {56 vars in 1093 bytes} [Thu May 26 16:44:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:06.892208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e48b6-2d8f-4227-82b8-aa4ca49e0fdf None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.004961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e48b6-2d8f-4227-82b8-aa4ca49e0fdf None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.007540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.040793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac392786-81d8-4141-acbd-ca622bfaa697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.041465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac392786-81d8-4141-acbd-ca622bfaa697 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.041750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac392786-81d8-4141-acbd-ca622bfaa697 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.042028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac392786-81d8-4141-acbd-ca622bfaa697 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.042867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac392786-81d8-4141-acbd-ca622bfaa697 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:07.043234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac392786-81d8-4141-acbd-ca622bfaa697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.045216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac392786-81d8-4141-acbd-ca622bfaa697 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.069521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 521/1028] 10.222.0.93 () {56 vars in 1133 bytes} [Thu May 26 16:44:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:07.070913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645c731-e245-4e8e-9c9f-b840bc7728e2 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.188141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645c731-e245-4e8e-9c9f-b840bc7728e2 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.229613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce349445-d843-42dd-b77f-7eafd9178100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.230259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349445-d843-42dd-b77f-7eafd9178100 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.230544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349445-d843-42dd-b77f-7eafd9178100 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.231386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349445-d843-42dd-b77f-7eafd9178100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.234217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.308296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce349445-d843-42dd-b77f-7eafd9178100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.309836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce349445-d843-42dd-b77f-7eafd9178100 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.388431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee677b56-177b-478c-9018-2a505d33dc29 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.388699 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee677b56-177b-478c-9018-2a505d33dc29 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.388885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee677b56-177b-478c-9018-2a505d33dc29 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.390658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 522/1029] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:44:07.397812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd58af-921b-4479-a755-f1ef791c1024 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.398099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd58af-921b-4479-a755-f1ef791c1024 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.398678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd58af-921b-4479-a755-f1ef791c1024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.420020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-fcbd58af-921b-4479-a755-f1ef791c1024 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:07.421257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-fcbd58af-921b-4479-a755-f1ef791c1024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.431876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 508/1030] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:44:07.437691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce349445-d843-42dd-b77f-7eafd9178100 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.484823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.510036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 523/1031] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:07.533911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd58af-921b-4479-a755-f1ef791c1024 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.569003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce349445-d843-42dd-b77f-7eafd9178100 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.609952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b98450-321e-4f7d-b859-9e106e830cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.610775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b98450-321e-4f7d-b859-9e106e830cd8 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.611052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b98450-321e-4f7d-b859-9e106e830cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.611337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b98450-321e-4f7d-b859-9e106e830cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.623835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b98450-321e-4f7d-b859-9e106e830cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.625329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b98450-321e-4f7d-b859-9e106e830cd8 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.643403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-96b98450-321e-4f7d-b859-9e106e830cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:44:07.645239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:07.646377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:07.656501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:44:07.656501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:44:07.656501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:07.656501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:07.656501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 509/1032] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:44:07.656501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b98450-321e-4f7d-b859-9e106e830cd8 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.662190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd58af-921b-4479-a755-f1ef791c1024 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.713900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59326322-9dc0-435d-9243-944d8c09cfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.714715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59326322-9dc0-435d-9243-944d8c09cfe4 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.714999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59326322-9dc0-435d-9243-944d8c09cfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.715275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59326322-9dc0-435d-9243-944d8c09cfe4 None admin] PATH_INFO: `/v3/services/image` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.715988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59326322-9dc0-435d-9243-944d8c09cfe4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.717452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59326322-9dc0-435d-9243-944d8c09cfe4 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-59326322-9dc0-435d-9243-944d8c09cfe4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:07.730942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:07.732219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:07.733098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 524/1033] 10.222.0.93 () {56 vars in 1105 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:44:07.738575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59326322-9dc0-435d-9243-944d8c09cfe4 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.789911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.810206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b98450-321e-4f7d-b859-9e106e830cd8 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.854587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af305-3775-462a-8771-ab4821db6dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.857072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af305-3775-462a-8771-ab4821db6dae None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.857072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af305-3775-462a-8771-ab4821db6dae None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.857072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af305-3775-462a-8771-ab4821db6dae None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.857072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af305-3775-462a-8771-ab4821db6dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:07.857072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af305-3775-462a-8771-ab4821db6dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.858339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af305-3775-462a-8771-ab4821db6dae None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.871972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 510/1034] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:07.877607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af305-3775-462a-8771-ab4821db6dae None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.885778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59326322-9dc0-435d-9243-944d8c09cfe4 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.924271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279caaf0-3b80-4d6c-99a7-6c01fbf3f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.924935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279caaf0-3b80-4d6c-99a7-6c01fbf3f6da None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.925183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279caaf0-3b80-4d6c-99a7-6c01fbf3f6da None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.925387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279caaf0-3b80-4d6c-99a7-6c01fbf3f6da None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.926105 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279caaf0-3b80-4d6c-99a7-6c01fbf3f6da None admin] RBAC: Adding query filter params (name=image) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:07.926413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279caaf0-3b80-4d6c-99a7-6c01fbf3f6da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.927832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279caaf0-3b80-4d6c-99a7-6c01fbf3f6da None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.933240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 525/1035] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:07.935188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bce761-fd15-4ab8-9c8e-f36a001d8e02 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.935474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bce761-fd15-4ab8-9c8e-f36a001d8e02 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.935771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bce761-fd15-4ab8-9c8e-f36a001d8e02 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.937056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 526/1036] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:07.942684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bce761-fd15-4ab8-9c8e-f36a001d8e02 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.969794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.998435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af305-3775-462a-8771-ab4821db6dae None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.038140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d3b79-00dc-4630-b345-34b36f851eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.038950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3b79-00dc-4630-b345-34b36f851eac None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.039232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3b79-00dc-4630-b345-34b36f851eac None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.039515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3b79-00dc-4630-b345-34b36f851eac None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.047605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d3b79-00dc-4630-b345-34b36f851eac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.049100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d3b79-00dc-4630-b345-34b36f851eac None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.056463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bce761-fd15-4ab8-9c8e-f36a001d8e02 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-427d3b79-00dc-4630-b345-34b36f851eac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:44:08.066599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:08.068109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:08.069063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:44:08.069063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:44:08.069063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:44:08.069063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:44:08.069063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:44:08.069063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:44:08.069063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:44:08.069063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:08.069063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 511/1037] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:44:08.069860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf541c2f-5af8-4d0a-b68f-391411c6b334 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.069860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf541c2f-5af8-4d0a-b68f-391411c6b334 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.069860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf541c2f-5af8-4d0a-b68f-391411c6b334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.081525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.088703 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-cf541c2f-5af8-4d0a-b68f-391411c6b334 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:08.091731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-cf541c2f-5af8-4d0a-b68f-391411c6b334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:08.103899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd64b5-7aeb-4ec9-a8c5-368f6a30271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.104569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd64b5-7aeb-4ec9-a8c5-368f6a30271d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.104961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd64b5-7aeb-4ec9-a8c5-368f6a30271d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.105112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd64b5-7aeb-4ec9-a8c5-368f6a30271d None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.106342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd64b5-7aeb-4ec9-a8c5-368f6a30271d None admin] RBAC: Adding query filter params (type=image) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:08.106645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd64b5-7aeb-4ec9-a8c5-368f6a30271d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.108072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd64b5-7aeb-4ec9-a8c5-368f6a30271d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.113716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 527/1038] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:08.114578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd64b5-7aeb-4ec9-a8c5-368f6a30271d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.169103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 512/1039] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:08.169974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf541c2f-5af8-4d0a-b68f-391411c6b334 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.223863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.243516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd64b5-7aeb-4ec9-a8c5-368f6a30271d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.283035 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb485d-2973-4635-a7bc-a17348833864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.283725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb485d-2973-4635-a7bc-a17348833864 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.284009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb485d-2973-4635-a7bc-a17348833864 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.284277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb485d-2973-4635-a7bc-a17348833864 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.285059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb485d-2973-4635-a7bc-a17348833864 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:08.285365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb485d-2973-4635-a7bc-a17348833864 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.286321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf541c2f-5af8-4d0a-b68f-391411c6b334 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.286817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb485d-2973-4635-a7bc-a17348833864 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.301495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 528/1040] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:08.302466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb485d-2973-4635-a7bc-a17348833864 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.328678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bed377-46dc-4970-8bb5-ed9f5b39fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.329340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bed377-46dc-4970-8bb5-ed9f5b39fab1 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.329618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bed377-46dc-4970-8bb5-ed9f5b39fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.329887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bed377-46dc-4970-8bb5-ed9f5b39fab1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.330675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bed377-46dc-4970-8bb5-ed9f5b39fab1 None admin] RBAC: Adding query filter params (interface=public, service_id=8ac3647f29284859b3225d7c6f0b8568, region_id=RegionOne) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:08.330979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bed377-46dc-4970-8bb5-ed9f5b39fab1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.332375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bed377-46dc-4970-8bb5-ed9f5b39fab1 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.334902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.338143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 513/1041] 10.222.0.93 () {56 vars in 1251 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/endpoints?service_id=8ac3647f29284859b3225d7c6f0b8568&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:08.339004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bed377-46dc-4970-8bb5-ed9f5b39fab1 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.411367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb485d-2973-4635-a7bc-a17348833864 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.450918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6346ba-3ef0-42d5-86a6-37b7bbf02725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.451759 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6346ba-3ef0-42d5-86a6-37b7bbf02725 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.452044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6346ba-3ef0-42d5-86a6-37b7bbf02725 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.452409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6346ba-3ef0-42d5-86a6-37b7bbf02725 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.453606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6346ba-3ef0-42d5-86a6-37b7bbf02725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.454534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bed377-46dc-4970-8bb5-ed9f5b39fab1 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.455075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6346ba-3ef0-42d5-86a6-37b7bbf02725 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.456971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 529/1042] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:08.457770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6346ba-3ef0-42d5-86a6-37b7bbf02725 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.474518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.498841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a33c80-db0b-4014-8a75-7bdcef3e4f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.499504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a33c80-db0b-4014-8a75-7bdcef3e4f9b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.499841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a33c80-db0b-4014-8a75-7bdcef3e4f9b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.500123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a33c80-db0b-4014-8a75-7bdcef3e4f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.500967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a33c80-db0b-4014-8a75-7bdcef3e4f9b None admin] RBAC: Adding query filter params (role.id=a99210ab096549e8bebb05c3d5010884, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=8dd8a5a74a2947e385ca0cb7f3ee6428) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:08.501279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a33c80-db0b-4014-8a75-7bdcef3e4f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.502738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a33c80-db0b-4014-8a75-7bdcef3e4f9b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.510037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 514/1043] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/role_assignments?user.id=8dd8a5a74a2947e385ca0cb7f3ee6428&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a99210ab096549e8bebb05c3d5010884 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:08.511087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a33c80-db0b-4014-8a75-7bdcef3e4f9b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.602299 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.611675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6346ba-3ef0-42d5-86a6-37b7bbf02725 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.656048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a33c80-db0b-4014-8a75-7bdcef3e4f9b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.666826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc48e8-35f5-4aa1-b711-1842a1b567aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.667760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc48e8-35f5-4aa1-b711-1842a1b567aa None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.668774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc48e8-35f5-4aa1-b711-1842a1b567aa None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.669174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc48e8-35f5-4aa1-b711-1842a1b567aa None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.671642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc48e8-35f5-4aa1-b711-1842a1b567aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.676833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc48e8-35f5-4aa1-b711-1842a1b567aa None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.688736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 530/1044] 10.222.0.93 () {56 vars in 1087 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/services => generated 1957 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:08.709684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f20bb-91ae-4840-8d5d-28ae0fb825e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.710429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f20bb-91ae-4840-8d5d-28ae0fb825e3 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.710712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f20bb-91ae-4840-8d5d-28ae0fb825e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.710988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f20bb-91ae-4840-8d5d-28ae0fb825e3 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.711794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f20bb-91ae-4840-8d5d-28ae0fb825e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.713514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f20bb-91ae-4840-8d5d-28ae0fb825e3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.836700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 515/1045] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:44:08 2022] POST /identity/v3/users => generated 285 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:10.914450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a7392-35aa-48cf-98c8-f98aec7a8a59 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.915006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a7392-35aa-48cf-98c8-f98aec7a8a59 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.915006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a7392-35aa-48cf-98c8-f98aec7a8a59 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.916391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 531/1046] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:10.922903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd135e81-ccc6-4547-9997-5a24473a34ac None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.923423 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd135e81-ccc6-4547-9997-5a24473a34ac None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.923742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd135e81-ccc6-4547-9997-5a24473a34ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.941309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-bd135e81-ccc6-4547-9997-5a24473a34ac None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:10.942525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bd135e81-ccc6-4547-9997-5a24473a34ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:10.957781 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9ffb-6c54-481c-82d2-5e4e543682ae None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.958644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9ffb-6c54-481c-82d2-5e4e543682ae None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.959168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9ffb-6c54-481c-82d2-5e4e543682ae None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.962349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 532/1047] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:10.970137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4b48-7708-438a-b040-61d948bcc80c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.970422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4b48-7708-438a-b040-61d948bcc80c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.970709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4b48-7708-438a-b040-61d948bcc80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.989211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-96dd4b48-7708-438a-b040-61d948bcc80c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:10.990429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-96dd4b48-7708-438a-b040-61d948bcc80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:11.024802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 516/1048] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:11.048128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd135e81-ccc6-4547-9997-5a24473a34ac None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.073371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 533/1049] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:44:11.097629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd4b48-7708-438a-b040-61d948bcc80c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.106220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.114938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.176653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd135e81-ccc6-4547-9997-5a24473a34ac None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.212301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd4b48-7708-438a-b040-61d948bcc80c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.214922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04364bcb-f967-4de8-952e-72a67c5d44c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.216417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04364bcb-f967-4de8-952e-72a67c5d44c9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.216753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04364bcb-f967-4de8-952e-72a67c5d44c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.217037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04364bcb-f967-4de8-952e-72a67c5d44c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.231847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04364bcb-f967-4de8-952e-72a67c5d44c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-04364bcb-f967-4de8-952e-72a67c5d44c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:44:11.243606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:11.245136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:11.246056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 517/1050] 10.222.0.93 () {56 vars in 1120 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:11.252086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04364bcb-f967-4de8-952e-72a67c5d44c9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.255876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6e073-3a87-4325-a211-be535b91f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.256681 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e073-3a87-4325-a211-be535b91f200 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.256959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e073-3a87-4325-a211-be535b91f200 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.257236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e073-3a87-4325-a211-be535b91f200 None admin] PATH_INFO: `/v3/services/image` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.257900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6e073-3a87-4325-a211-be535b91f200 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.259272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6e073-3a87-4325-a211-be535b91f200 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-84a6e073-3a87-4325-a211-be535b91f200 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:11.272345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:11.273466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:44:11.274329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:11.281932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 534/1051] 10.222.0.93 () {56 vars in 1105 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:44:11.283753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6e073-3a87-4325-a211-be535b91f200 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.361161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.382096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04364bcb-f967-4de8-952e-72a67c5d44c9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.393527 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.395342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6e073-3a87-4325-a211-be535b91f200 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.420017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80539f1-68d3-4624-80a6-de11ac89821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.420684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80539f1-68d3-4624-80a6-de11ac89821c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.420968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80539f1-68d3-4624-80a6-de11ac89821c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.422427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80539f1-68d3-4624-80a6-de11ac89821c None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.422427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80539f1-68d3-4624-80a6-de11ac89821c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:11.422427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80539f1-68d3-4624-80a6-de11ac89821c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.423974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80539f1-68d3-4624-80a6-de11ac89821c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.432795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 518/1052] 10.222.0.93 () {56 vars in 1115 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:11.434470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e345e-567e-4adc-99aa-99e8cbe5161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.434639 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f816-6554-4932-b2ed-653727793cc8 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.434916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f816-6554-4932-b2ed-653727793cc8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.435192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f816-6554-4932-b2ed-653727793cc8 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.435292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e345e-567e-4adc-99aa-99e8cbe5161f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.435580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e345e-567e-4adc-99aa-99e8cbe5161f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.435868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e345e-567e-4adc-99aa-99e8cbe5161f None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.436664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 519/1053] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:11.436770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e345e-567e-4adc-99aa-99e8cbe5161f None admin] RBAC: Adding query filter params (name=image) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:11.437064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e345e-567e-4adc-99aa-99e8cbe5161f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.438812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e345e-567e-4adc-99aa-99e8cbe5161f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.440488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88f816-6554-4932-b2ed-653727793cc8 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.445441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 535/1054] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:11.446784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003c3b3-11e8-4762-b78d-ca18ad6b93bb None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.447179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003c3b3-11e8-4762-b78d-ca18ad6b93bb None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.447382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003c3b3-11e8-4762-b78d-ca18ad6b93bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.465756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4003c3b3-11e8-4762-b78d-ca18ad6b93bb None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:11.466868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4003c3b3-11e8-4762-b78d-ca18ad6b93bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:11.547613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 536/1055] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:11.547613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003c3b3-11e8-4762-b78d-ca18ad6b93bb None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.557135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88f816-6554-4932-b2ed-653727793cc8 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.597114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7059d5-ebf9-4c9a-8033-c9d68aad2122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.598100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7059d5-ebf9-4c9a-8033-c9d68aad2122 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.598481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7059d5-ebf9-4c9a-8033-c9d68aad2122 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.598848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7059d5-ebf9-4c9a-8033-c9d68aad2122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.616694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7059d5-ebf9-4c9a-8033-c9d68aad2122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.618823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7059d5-ebf9-4c9a-8033-c9d68aad2122 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.637992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-1b7059d5-ebf9-4c9a-8033-c9d68aad2122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:44:11.639897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:11.640955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:11.641884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:44:11.641884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:44:11.641884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:11.641884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:11.641884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 520/1056] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:11.642188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7059d5-ebf9-4c9a-8033-c9d68aad2122 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.679744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.687233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003c3b3-11e8-4762-b78d-ca18ad6b93bb None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.728373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b077f-2067-45da-b4a5-47b8d734b74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.728976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b077f-2067-45da-b4a5-47b8d734b74d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.729263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b077f-2067-45da-b4a5-47b8d734b74d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.729530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b077f-2067-45da-b4a5-47b8d734b74d None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.730274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b077f-2067-45da-b4a5-47b8d734b74d None admin] RBAC: Adding query filter params (type=image) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:11.730606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b077f-2067-45da-b4a5-47b8d734b74d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.732200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b077f-2067-45da-b4a5-47b8d734b74d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.738518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 537/1057] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:11.739427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b077f-2067-45da-b4a5-47b8d734b74d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.773349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7059d5-ebf9-4c9a-8033-c9d68aad2122 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.820817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05141174-aa47-45c7-99a4-4dc584ce9af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.822154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05141174-aa47-45c7-99a4-4dc584ce9af7 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.822577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05141174-aa47-45c7-99a4-4dc584ce9af7 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.822984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05141174-aa47-45c7-99a4-4dc584ce9af7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.836826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05141174-aa47-45c7-99a4-4dc584ce9af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-05141174-aa47-45c7-99a4-4dc584ce9af7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:44:11.845158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:11.851194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 521/1058] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:11.852374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05141174-aa47-45c7-99a4-4dc584ce9af7 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.868670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b077f-2067-45da-b4a5-47b8d734b74d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.904254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.913087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25d4aa-e4e4-4cf7-bbeb-77b4e923ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.913753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25d4aa-e4e4-4cf7-bbeb-77b4e923ebab None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.914038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25d4aa-e4e4-4cf7-bbeb-77b4e923ebab None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.914314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25d4aa-e4e4-4cf7-bbeb-77b4e923ebab None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.915044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25d4aa-e4e4-4cf7-bbeb-77b4e923ebab None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:11.915695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25d4aa-e4e4-4cf7-bbeb-77b4e923ebab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.916795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25d4aa-e4e4-4cf7-bbeb-77b4e923ebab None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.929054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 538/1059] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:11.929872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25d4aa-e4e4-4cf7-bbeb-77b4e923ebab None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.952796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.969992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05141174-aa47-45c7-99a4-4dc584ce9af7 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.010087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ded10-5bc3-4def-9310-55a00b7ac161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.010087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ded10-5bc3-4def-9310-55a00b7ac161 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.010087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ded10-5bc3-4def-9310-55a00b7ac161 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.010087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ded10-5bc3-4def-9310-55a00b7ac161 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.010540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ded10-5bc3-4def-9310-55a00b7ac161 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.010540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ded10-5bc3-4def-9310-55a00b7ac161 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.036482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25d4aa-e4e4-4cf7-bbeb-77b4e923ebab None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.071887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c381ea-6c47-4d58-9a14-0fd33323e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.072556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c381ea-6c47-4d58-9a14-0fd33323e331 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.072839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c381ea-6c47-4d58-9a14-0fd33323e331 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.073257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c381ea-6c47-4d58-9a14-0fd33323e331 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.073974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c381ea-6c47-4d58-9a14-0fd33323e331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:12.074284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c381ea-6c47-4d58-9a14-0fd33323e331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.075780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c381ea-6c47-4d58-9a14-0fd33323e331 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.084713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 539/1060] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:12.085532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c381ea-6c47-4d58-9a14-0fd33323e331 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.132302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 522/1061] 10.222.0.93 () {60 vars in 1144 bytes} [Thu May 26 16:44:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:12.133155 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ded10-5bc3-4def-9310-55a00b7ac161 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.145278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:12.206462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c381ea-6c47-4d58-9a14-0fd33323e331 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.257967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65724135-7df8-47d8-8bdb-b2278ec3e7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.258790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65724135-7df8-47d8-8bdb-b2278ec3e7d0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.259081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65724135-7df8-47d8-8bdb-b2278ec3e7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.259351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65724135-7df8-47d8-8bdb-b2278ec3e7d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.261520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ded10-5bc3-4def-9310-55a00b7ac161 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.269305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65724135-7df8-47d8-8bdb-b2278ec3e7d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.275297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65724135-7df8-47d8-8bdb-b2278ec3e7d0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-65724135-7df8-47d8-8bdb-b2278ec3e7d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:44:12.288762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:12.289825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:12.290993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 540/1062] 10.222.0.93 () {56 vars in 1093 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:12.297116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65724135-7df8-47d8-8bdb-b2278ec3e7d0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.317681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232bd2-3e98-487b-979e-37fddcb022f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.318582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232bd2-3e98-487b-979e-37fddcb022f3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.318864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232bd2-3e98-487b-979e-37fddcb022f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.319137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232bd2-3e98-487b-979e-37fddcb022f3 None admin] PATH_INFO: `/v3/users/2c1d625ee1a94e07b2529f87ccb757d0` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.332738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:12.336243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94232bd2-3e98-487b-979e-37fddcb022f3 None admin] RBAC: Authorizing `identity:get_user(user_id=2c1d625ee1a94e07b2529f87ccb757d0)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.337734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94232bd2-3e98-487b-979e-37fddcb022f3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.339613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 523/1063] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/users/2c1d625ee1a94e07b2529f87ccb757d0 => generated 285 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:12.349921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232bd2-3e98-487b-979e-37fddcb022f3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.437999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65724135-7df8-47d8-8bdb-b2278ec3e7d0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.447048 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:12.463935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232bd2-3e98-487b-979e-37fddcb022f3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.479814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96834499-7b00-405b-93c9-faae3338ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.481543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96834499-7b00-405b-93c9-faae3338ee7f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.482111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96834499-7b00-405b-93c9-faae3338ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.483360 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96834499-7b00-405b-93c9-faae3338ee7f None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.484336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96834499-7b00-405b-93c9-faae3338ee7f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:12.484676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96834499-7b00-405b-93c9-faae3338ee7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.486379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96834499-7b00-405b-93c9-faae3338ee7f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.504821 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8730cfd-5267-431b-8be6-0e7e18c05e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.505483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8730cfd-5267-431b-8be6-0e7e18c05e1e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.505767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8730cfd-5267-431b-8be6-0e7e18c05e1e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.506046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8730cfd-5267-431b-8be6-0e7e18c05e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.515175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 541/1064] 10.222.0.93 () {56 vars in 1133 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:12.516960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96834499-7b00-405b-93c9-faae3338ee7f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.579355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:12.583047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8730cfd-5267-431b-8be6-0e7e18c05e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.584647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8730cfd-5267-431b-8be6-0e7e18c05e1e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.639134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96834499-7b00-405b-93c9-faae3338ee7f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.682261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f549f12-3364-4131-a373-d6b1e1c9799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.683373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549f12-3364-4131-a373-d6b1e1c9799f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.683706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549f12-3364-4131-a373-d6b1e1c9799f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.683968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549f12-3364-4131-a373-d6b1e1c9799f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.697434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f549f12-3364-4131-a373-d6b1e1c9799f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.698922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f549f12-3364-4131-a373-d6b1e1c9799f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.701313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 524/1065] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:44:12.707056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8730cfd-5267-431b-8be6-0e7e18c05e1e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-5f549f12-3364-4131-a373-d6b1e1c9799f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:44:12.721404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:12.722620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:12.723880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:44:12.723880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:44:12.723880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:12.723880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:12.733843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 542/1066] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:12.735037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f549f12-3364-4131-a373-d6b1e1c9799f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.762365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:12.853310 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:12.859149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8730cfd-5267-431b-8be6-0e7e18c05e1e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.862073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f549f12-3364-4131-a373-d6b1e1c9799f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:12.896502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8fdf8-dd49-4287-a17d-293887ee5f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.897370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8fdf8-dd49-4287-a17d-293887ee5f2e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.897656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8fdf8-dd49-4287-a17d-293887ee5f2e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.897935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8fdf8-dd49-4287-a17d-293887ee5f2e None admin] PATH_INFO: `/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.899328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8fdf8-dd49-4287-a17d-293887ee5f2e None admin] RBAC: Authorizing `identity:get_project(project_id=31fdc6f6b4bf48bd87407a2d96c687fd)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.900733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8fdf8-dd49-4287-a17d-293887ee5f2e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.903211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 525/1067] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd => generated 311 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:12.903407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28299a2-9d30-4ee7-8be3-786cc17a248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:12.903782 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28299a2-9d30-4ee7-8be3-786cc17a248c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:12.904064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28299a2-9d30-4ee7-8be3-786cc17a248c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:12.904477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28299a2-9d30-4ee7-8be3-786cc17a248c None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:12.905072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28299a2-9d30-4ee7-8be3-786cc17a248c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:12.905375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28299a2-9d30-4ee7-8be3-786cc17a248c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:12.906791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28299a2-9d30-4ee7-8be3-786cc17a248c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:12.909069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8fdf8-dd49-4287-a17d-293887ee5f2e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:12.920496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 543/1068] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:12.925931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28299a2-9d30-4ee7-8be3-786cc17a248c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:13.010890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:13.028566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8fdf8-dd49-4287-a17d-293887ee5f2e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:13.040688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28299a2-9d30-4ee7-8be3-786cc17a248c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:13.066409 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da38f51-3317-4ca9-9946-22082687cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:13.067064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da38f51-3317-4ca9-9946-22082687cb7b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:13.067349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da38f51-3317-4ca9-9946-22082687cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:13.067655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da38f51-3317-4ca9-9946-22082687cb7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:13.068498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da38f51-3317-4ca9-9946-22082687cb7b None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=31fdc6f6b4bf48bd87407a2d96c687fd, user.id=2c1d625ee1a94e07b2529f87ccb757d0) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:13.068808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da38f51-3317-4ca9-9946-22082687cb7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:13.070241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da38f51-3317-4ca9-9946-22082687cb7b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:13.077210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 526/1069] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/role_assignments?user.id=2c1d625ee1a94e07b2529f87ccb757d0&scope.project.id=31fdc6f6b4bf48bd87407a2d96c687fd&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:13.078164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f9238-45ab-49c8-ad56-7acbf6e440b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:13.079189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f9238-45ab-49c8-ad56-7acbf6e440b6 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:13.079725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f9238-45ab-49c8-ad56-7acbf6e440b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:13.080194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f9238-45ab-49c8-ad56-7acbf6e440b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:13.088338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f9238-45ab-49c8-ad56-7acbf6e440b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:13.090297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f9238-45ab-49c8-ad56-7acbf6e440b6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-815f9238-45ab-49c8-ad56-7acbf6e440b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:44:13.107200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:13.108426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:13.109396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:44:13.109396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:44:13.109396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:44:13.109396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:44:13.109396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:44:13.109396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:44:13.109396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:44:13.109396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:13.111769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 544/1070] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:44:13.118686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da38f51-3317-4ca9-9946-22082687cb7b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:13.169788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:13.292219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da38f51-3317-4ca9-9946-22082687cb7b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:13.347315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773b4d3-d852-4c44-a764-9b61d86f16a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:13.348021 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773b4d3-d852-4c44-a764-9b61d86f16a1 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:13.348303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773b4d3-d852-4c44-a764-9b61d86f16a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:13.348577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773b4d3-d852-4c44-a764-9b61d86f16a1 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:13.349373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773b4d3-d852-4c44-a764-9b61d86f16a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:13.349682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773b4d3-d852-4c44-a764-9b61d86f16a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:13.351128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773b4d3-d852-4c44-a764-9b61d86f16a1 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:13.364757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 527/1071] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:44:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:13.370787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f9238-45ab-49c8-ad56-7acbf6e440b6 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:13.481075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f9238-45ab-49c8-ad56-7acbf6e440b6 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:13.518690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bdafd-7fe8-4cfc-8697-e7cf2a992436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:13.519684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bdafd-7fe8-4cfc-8697-e7cf2a992436 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:13.519971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bdafd-7fe8-4cfc-8697-e7cf2a992436 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:13.520249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bdafd-7fe8-4cfc-8697-e7cf2a992436 None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/8dd8a5a74a2947e385ca0cb7f3ee6428/roles/a99210ab096549e8bebb05c3d5010884` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:13.522516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bdafd-7fe8-4cfc-8697-e7cf2a992436 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=8dd8a5a74a2947e385ca0cb7f3ee6428, role_id=a99210ab096549e8bebb05c3d5010884)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:13.524000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bdafd-7fe8-4cfc-8697-e7cf2a992436 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:13.527365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:13.667645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 545/1072] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:44:13 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/8dd8a5a74a2947e385ca0cb7f3ee6428/roles/a99210ab096549e8bebb05c3d5010884 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:14.432079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3df0a6-f306-491d-a06e-b2a62c87d99e None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.432863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3df0a6-f306-491d-a06e-b2a62c87d99e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.432863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3df0a6-f306-491d-a06e-b2a62c87d99e None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.434239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 528/1073] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:14.440019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b374bf7-0357-4526-a815-1d9918c909f1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.440644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b374bf7-0357-4526-a815-1d9918c909f1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.440644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b374bf7-0357-4526-a815-1d9918c909f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.458815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-0b374bf7-0357-4526-a815-1d9918c909f1 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:14.460039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-0b374bf7-0357-4526-a815-1d9918c909f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.562542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 546/1074] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:14.587278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3df0a6-f306-491d-a06e-b2a62c87d99e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:14.684738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:14.698210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3df0a6-f306-491d-a06e-b2a62c87d99e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:14.733711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346dbc6-cc62-4d3e-9f35-ed98e4478488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:14.734354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346dbc6-cc62-4d3e-9f35-ed98e4478488 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.734633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346dbc6-cc62-4d3e-9f35-ed98e4478488 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.734904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346dbc6-cc62-4d3e-9f35-ed98e4478488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.810329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346dbc6-cc62-4d3e-9f35-ed98e4478488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:14.811835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346dbc6-cc62-4d3e-9f35-ed98e4478488 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:14.957331 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:14.969327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 529/1075] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:44:14.975972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b374bf7-0357-4526-a815-1d9918c909f1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.099139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b374bf7-0357-4526-a815-1d9918c909f1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.127076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:15.136260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e14f54-98bc-484e-a071-6cf16c102986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.137083 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e14f54-98bc-484e-a071-6cf16c102986 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.137362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e14f54-98bc-484e-a071-6cf16c102986 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.137630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e14f54-98bc-484e-a071-6cf16c102986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.147892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e14f54-98bc-484e-a071-6cf16c102986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.162203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e14f54-98bc-484e-a071-6cf16c102986 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-25e14f54-98bc-484e-a071-6cf16c102986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:44:15.168037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:15.169498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:15.175383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:44:15.175383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:44:15.175383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:15.175383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:15.175383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 547/1076] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:15.177160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346dbc6-cc62-4d3e-9f35-ed98e4478488 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.300171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346dbc6-cc62-4d3e-9f35-ed98e4478488 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.341841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4118f2-d061-4e53-b1f0-42dbdbe89435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.342515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4118f2-d061-4e53-b1f0-42dbdbe89435 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.343053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4118f2-d061-4e53-b1f0-42dbdbe89435 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.343327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4118f2-d061-4e53-b1f0-42dbdbe89435 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.344100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4118f2-d061-4e53-b1f0-42dbdbe89435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:15.344405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4118f2-d061-4e53-b1f0-42dbdbe89435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.345893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4118f2-d061-4e53-b1f0-42dbdbe89435 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.360461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 530/1077] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:15.492957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a2f4d-8f62-47de-8f2e-ca92a0aef5be None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.493536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a2f4d-8f62-47de-8f2e-ca92a0aef5be None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.493536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a2f4d-8f62-47de-8f2e-ca92a0aef5be None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.495200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 548/1078] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:15.501150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996b6a-fa23-4983-a505-ac2368a9d4de None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.501761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996b6a-fa23-4983-a505-ac2368a9d4de None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.501761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996b6a-fa23-4983-a505-ac2368a9d4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.523815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-fd996b6a-fa23-4983-a505-ac2368a9d4de None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:15.525132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fd996b6a-fa23-4983-a505-ac2368a9d4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.582292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:15.606265 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 531/1079] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:44:15.628712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a2f4d-8f62-47de-8f2e-ca92a0aef5be None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.755594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a2f4d-8f62-47de-8f2e-ca92a0aef5be None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.792471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f2bc7-83a3-4b7f-b28b-94515af1a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.793451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f2bc7-83a3-4b7f-b28b-94515af1a75b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.793769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f2bc7-83a3-4b7f-b28b-94515af1a75b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.794079 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f2bc7-83a3-4b7f-b28b-94515af1a75b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.805594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f2bc7-83a3-4b7f-b28b-94515af1a75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-a02f2bc7-83a3-4b7f-b28b-94515af1a75b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:44:15.814192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:15.820891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:15.821917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 549/1080] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:15.822678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd996b6a-fa23-4983-a505-ac2368a9d4de None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.934580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd996b6a-fa23-4983-a505-ac2368a9d4de None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.972605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44131783-4547-4352-9e11-693170fa0b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.973282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131783-4547-4352-9e11-693170fa0b97 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.973563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131783-4547-4352-9e11-693170fa0b97 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.973835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131783-4547-4352-9e11-693170fa0b97 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.974585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44131783-4547-4352-9e11-693170fa0b97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:15.974888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44131783-4547-4352-9e11-693170fa0b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.976337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44131783-4547-4352-9e11-693170fa0b97 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.985553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 532/1081] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:15.991723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f2bc7-83a3-4b7f-b28b-94515af1a75b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.029815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc60d9-0757-4f68-8812-dec4b17181ad None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.030104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc60d9-0757-4f68-8812-dec4b17181ad None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.030381 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc60d9-0757-4f68-8812-dec4b17181ad None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.032025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 533/1082] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:44:16.037558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf53ea-b542-487e-a4cb-463144afa96b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.037849 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf53ea-b542-487e-a4cb-463144afa96b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.038154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf53ea-b542-487e-a4cb-463144afa96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.039126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.055100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-dfcf53ea-b542-487e-a4cb-463144afa96b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:16.056411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-dfcf53ea-b542-487e-a4cb-463144afa96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.098913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.107688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f2bc7-83a3-4b7f-b28b-94515af1a75b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.132028 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 534/1083] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:44:16.143830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8785-4c45-4066-8bdf-674f7bbfc1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.144752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8785-4c45-4066-8bdf-674f7bbfc1fd None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.145031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8785-4c45-4066-8bdf-674f7bbfc1fd None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.145305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8785-4c45-4066-8bdf-674f7bbfc1fd None admin] PATH_INFO: `/v3/users/2c1d625ee1a94e07b2529f87ccb757d0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.146521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f8785-4c45-4066-8bdf-674f7bbfc1fd None admin] RBAC: Authorizing `identity:get_user(user_id=2c1d625ee1a94e07b2529f87ccb757d0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.148019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f8785-4c45-4066-8bdf-674f7bbfc1fd None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.149762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 550/1084] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:15 2022] GET /identity/v3/users/2c1d625ee1a94e07b2529f87ccb757d0 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:16.155602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf53ea-b542-487e-a4cb-463144afa96b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.156571 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8785-4c45-4066-8bdf-674f7bbfc1fd None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.264860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf53ea-b542-487e-a4cb-463144afa96b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.273552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8785-4c45-4066-8bdf-674f7bbfc1fd None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.280577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.310610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee843bcd-15aa-4c81-93f1-eb9e02d16e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.311423 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542d694-e45d-44ff-bdb2-4f24ce47ee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.311648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee843bcd-15aa-4c81-93f1-eb9e02d16e04 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.311786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee843bcd-15aa-4c81-93f1-eb9e02d16e04 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.312052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee843bcd-15aa-4c81-93f1-eb9e02d16e04 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.312305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542d694-e45d-44ff-bdb2-4f24ce47ee86 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.312587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542d694-e45d-44ff-bdb2-4f24ce47ee86 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.312861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542d694-e45d-44ff-bdb2-4f24ce47ee86 None admin] PATH_INFO: `/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.314038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542d694-e45d-44ff-bdb2-4f24ce47ee86 None admin] RBAC: Authorizing `identity:get_project(project_id=31fdc6f6b4bf48bd87407a2d96c687fd)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.315547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542d694-e45d-44ff-bdb2-4f24ce47ee86 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.317275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 535/1085] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:16.323052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee843bcd-15aa-4c81-93f1-eb9e02d16e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:44:16.324496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542d694-e45d-44ff-bdb2-4f24ce47ee86 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-ee843bcd-15aa-4c81-93f1-eb9e02d16e04 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:44:16.331224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:16.332657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 551/1086] 10.222.0.93 () {56 vars in 1120 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:44:16.338988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee843bcd-15aa-4c81-93f1-eb9e02d16e04 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.369020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.445413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542d694-e45d-44ff-bdb2-4f24ce47ee86 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.458116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee843bcd-15aa-4c81-93f1-eb9e02d16e04 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.492011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0ca9-94af-47a6-8f14-2501f97ab8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.493029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0ca9-94af-47a6-8f14-2501f97ab8cb None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.493365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0ca9-94af-47a6-8f14-2501f97ab8cb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.493693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0ca9-94af-47a6-8f14-2501f97ab8cb None admin] PATH_INFO: `/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd/users/2c1d625ee1a94e07b2529f87ccb757d0/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.496891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad0ca9-94af-47a6-8f14-2501f97ab8cb None admin] RBAC: Authorizing `identity:create_grant(project_id=31fdc6f6b4bf48bd87407a2d96c687fd, user_id=2c1d625ee1a94e07b2529f87ccb757d0, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.498643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad0ca9-94af-47a6-8f14-2501f97ab8cb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.500143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf114ab-468e-4103-bf27-1dfa4feaa58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.501290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf114ab-468e-4103-bf27-1dfa4feaa58a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.501792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf114ab-468e-4103-bf27-1dfa4feaa58a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.502288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf114ab-468e-4103-bf27-1dfa4feaa58a None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.503752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf114ab-468e-4103-bf27-1dfa4feaa58a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:16.504303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf114ab-468e-4103-bf27-1dfa4feaa58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.506888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf114ab-468e-4103-bf27-1dfa4feaa58a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.524171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 552/1087] 10.222.0.93 () {56 vars in 1115 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:16.528068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf114ab-468e-4103-bf27-1dfa4feaa58a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.557396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.639474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf114ab-468e-4103-bf27-1dfa4feaa58a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.663919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 536/1088] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:44:16 2022] PUT /identity/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd/users/2c1d625ee1a94e07b2529f87ccb757d0/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:16.677226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaf466-eb70-47a7-a1a0-0a7228fef62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.678045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaf466-eb70-47a7-a1a0-0a7228fef62b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.678319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaf466-eb70-47a7-a1a0-0a7228fef62b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.678590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaf466-eb70-47a7-a1a0-0a7228fef62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.693958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaf466-eb70-47a7-a1a0-0a7228fef62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.695477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaf466-eb70-47a7-a1a0-0a7228fef62b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-0ddaf466-eb70-47a7-a1a0-0a7228fef62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:44:16.714294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:16.716117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:16.717167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:44:16.717167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:44:16.717167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:16.717167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:16.717167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 553/1089] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:44:16.723807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0ca9-94af-47a6-8f14-2501f97ab8cb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.838559 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.841958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0ca9-94af-47a6-8f14-2501f97ab8cb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.880938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a2ff9-3930-450e-bd87-ee8945d7e864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.881607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a2ff9-3930-450e-bd87-ee8945d7e864 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.881890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a2ff9-3930-450e-bd87-ee8945d7e864 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.882163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a2ff9-3930-450e-bd87-ee8945d7e864 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.882897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a2ff9-3930-450e-bd87-ee8945d7e864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:16.883201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a2ff9-3930-450e-bd87-ee8945d7e864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.884710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a2ff9-3930-450e-bd87-ee8945d7e864 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.896420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 537/1090] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:16.902293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaf466-eb70-47a7-a1a0-0a7228fef62b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.992070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:17.011433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaf466-eb70-47a7-a1a0-0a7228fef62b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:17.047235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f451d-7cc1-4196-aeab-cceeb12eaa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:17.048130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f451d-7cc1-4196-aeab-cceeb12eaa32 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.048616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f451d-7cc1-4196-aeab-cceeb12eaa32 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.049126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f451d-7cc1-4196-aeab-cceeb12eaa32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.058054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f451d-7cc1-4196-aeab-cceeb12eaa32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:17.059525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f451d-7cc1-4196-aeab-cceeb12eaa32 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-311f451d-7cc1-4196-aeab-cceeb12eaa32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:44:17.075041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:17.076608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:17.078342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 554/1091] 10.222.0.93 () {56 vars in 1093 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:17.082292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a2ff9-3930-450e-bd87-ee8945d7e864 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:17.198908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a2ff9-3930-450e-bd87-ee8945d7e864 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:17.238842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7e9cd-af5f-4856-8154-7632de904bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:17.239773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7e9cd-af5f-4856-8154-7632de904bf6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.240059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7e9cd-af5f-4856-8154-7632de904bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.240340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7e9cd-af5f-4856-8154-7632de904bf6 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.241188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7e9cd-af5f-4856-8154-7632de904bf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:17.241500 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7e9cd-af5f-4856-8154-7632de904bf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:17.243277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7e9cd-af5f-4856-8154-7632de904bf6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:17.263912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 538/1092] 10.222.0.93 () {56 vars in 1133 bytes} [Thu May 26 16:44:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:17.269987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f451d-7cc1-4196-aeab-cceeb12eaa32 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:17.385159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f451d-7cc1-4196-aeab-cceeb12eaa32 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:17.436318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5e324-2879-4134-a0da-c1fd5f31944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:17.437415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5e324-2879-4134-a0da-c1fd5f31944f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.437927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5e324-2879-4134-a0da-c1fd5f31944f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.438430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5e324-2879-4134-a0da-c1fd5f31944f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.456574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:17.519535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5e324-2879-4134-a0da-c1fd5f31944f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:17.521039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5e324-2879-4134-a0da-c1fd5f31944f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:17.629128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 555/1093] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:44:17.635065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7e9cd-af5f-4856-8154-7632de904bf6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:17.655595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:17.750046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7e9cd-af5f-4856-8154-7632de904bf6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:17.800365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bca7e-e7d9-4c78-b4a9-a144d50963a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:17.801182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bca7e-e7d9-4c78-b4a9-a144d50963a4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.801461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bca7e-e7d9-4c78-b4a9-a144d50963a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.801734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bca7e-e7d9-4c78-b4a9-a144d50963a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.814290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bca7e-e7d9-4c78-b4a9-a144d50963a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:17.816513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bca7e-e7d9-4c78-b4a9-a144d50963a4 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-b59bca7e-e7d9-4c78-b4a9-a144d50963a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:44:17.835994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:17.837866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:17.839784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:44:17.839784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:44:17.839784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:44:17.839784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:17.839784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 539/1094] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:17.847757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5e324-2879-4134-a0da-c1fd5f31944f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:17.899859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:17.960121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5e324-2879-4134-a0da-c1fd5f31944f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:17.998633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90641b-0919-4f1b-8f86-5bb2a4b5d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:17.999306 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90641b-0919-4f1b-8f86-5bb2a4b5d00d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:18.001694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90641b-0919-4f1b-8f86-5bb2a4b5d00d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:18.001694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90641b-0919-4f1b-8f86-5bb2a4b5d00d None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:18.001694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90641b-0919-4f1b-8f86-5bb2a4b5d00d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:18.001694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90641b-0919-4f1b-8f86-5bb2a4b5d00d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:18.002324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90641b-0919-4f1b-8f86-5bb2a4b5d00d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:18.017772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 556/1095] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:18.023896 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bca7e-e7d9-4c78-b4a9-a144d50963a4 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:18.099186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:18.145567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bca7e-e7d9-4c78-b4a9-a144d50963a4 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:18.188532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1baab-50d1-447c-8067-dcb4d81995f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:18.189477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1baab-50d1-447c-8067-dcb4d81995f7 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:18.189867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1baab-50d1-447c-8067-dcb4d81995f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:18.190224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1baab-50d1-447c-8067-dcb4d81995f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:18.199154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1baab-50d1-447c-8067-dcb4d81995f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:18.201048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1baab-50d1-447c-8067-dcb4d81995f7 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-d1a1baab-50d1-447c-8067-dcb4d81995f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:44:18.220221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:18.221258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:18.222201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:44:18.222201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:44:18.222201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:44:18.222201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:44:18.222201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:44:18.222201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:44:18.222201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:44:18.222201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:18.222201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 540/1096] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:18.227481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90641b-0919-4f1b-8f86-5bb2a4b5d00d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:18.337256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:18.341014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90641b-0919-4f1b-8f86-5bb2a4b5d00d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:18.386525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecdf92-d859-4f27-8b96-2b1e8b689de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:18.387239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecdf92-d859-4f27-8b96-2b1e8b689de0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:18.387524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecdf92-d859-4f27-8b96-2b1e8b689de0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:18.387831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecdf92-d859-4f27-8b96-2b1e8b689de0 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:18.388678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecdf92-d859-4f27-8b96-2b1e8b689de0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:18.388989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecdf92-d859-4f27-8b96-2b1e8b689de0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:18.390481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecdf92-d859-4f27-8b96-2b1e8b689de0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:18.405403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 557/1097] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:44:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:18.414360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1baab-50d1-447c-8067-dcb4d81995f7 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:18.550436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1baab-50d1-447c-8067-dcb4d81995f7 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:18.582377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:18.588994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040147f2-0a1e-4792-90d4-890472f6f84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:18.589576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040147f2-0a1e-4792-90d4-890472f6f84e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:18.590535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040147f2-0a1e-4792-90d4-890472f6f84e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:18.590796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040147f2-0a1e-4792-90d4-890472f6f84e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:18.591654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040147f2-0a1e-4792-90d4-890472f6f84e None admin] RBAC: Adding query filter params (role.id=a99210ab096549e8bebb05c3d5010884, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=8dd8a5a74a2947e385ca0cb7f3ee6428) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:18.591971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040147f2-0a1e-4792-90d4-890472f6f84e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:18.593717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040147f2-0a1e-4792-90d4-890472f6f84e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:18.600348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 541/1098] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:44:18 2022] GET /identity/v3/role_assignments?user.id=8dd8a5a74a2947e385ca0cb7f3ee6428&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a99210ab096549e8bebb05c3d5010884 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:18.932429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cbd8e-5be2-480c-baef-bd53dcee926a None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:18.932920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cbd8e-5be2-480c-baef-bd53dcee926a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:18.932920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cbd8e-5be2-480c-baef-bd53dcee926a None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:18.934782 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 558/1099] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:18.940772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f122c-417c-430a-9b3a-71ff36dc2f41 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:18.941256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f122c-417c-430a-9b3a-71ff36dc2f41 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:18.941351 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f122c-417c-430a-9b3a-71ff36dc2f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:18.959706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-890f122c-417c-430a-9b3a-71ff36dc2f41 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:18.960909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-890f122c-417c-430a-9b3a-71ff36dc2f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:19.033744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 542/1100] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:19.056965 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cbd8e-5be2-480c-baef-bd53dcee926a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:19.169415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cbd8e-5be2-480c-baef-bd53dcee926a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:19.211376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b089-9f6f-466e-a55f-ca04a7ed689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:19.212234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b089-9f6f-466e-a55f-ca04a7ed689c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:19.212515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b089-9f6f-466e-a55f-ca04a7ed689c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:19.212789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b089-9f6f-466e-a55f-ca04a7ed689c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:19.226709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12b089-9f6f-466e-a55f-ca04a7ed689c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-bd12b089-9f6f-466e-a55f-ca04a7ed689c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:44:19.236387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:19.237427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:19.238444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 559/1101] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:19.245114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f122c-417c-430a-9b3a-71ff36dc2f41 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:19.376702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f122c-417c-430a-9b3a-71ff36dc2f41 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:19.421174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:19.432419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef953d7-80b8-4d7e-8060-22dce7af79dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:19.436918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef953d7-80b8-4d7e-8060-22dce7af79dd None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:19.436918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef953d7-80b8-4d7e-8060-22dce7af79dd None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:19.436918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef953d7-80b8-4d7e-8060-22dce7af79dd None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:19.436918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef953d7-80b8-4d7e-8060-22dce7af79dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:19.436918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef953d7-80b8-4d7e-8060-22dce7af79dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:19.436918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef953d7-80b8-4d7e-8060-22dce7af79dd None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:19.448172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 543/1102] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:19.454901 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b089-9f6f-466e-a55f-ca04a7ed689c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:19.482813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:19.567286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b089-9f6f-466e-a55f-ca04a7ed689c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:19.602996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c68098-a7c4-4353-be95-83107e630338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:19.603895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c68098-a7c4-4353-be95-83107e630338 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:19.604181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c68098-a7c4-4353-be95-83107e630338 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:19.604459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c68098-a7c4-4353-be95-83107e630338 None admin] PATH_INFO: `/v3/users/2c1d625ee1a94e07b2529f87ccb757d0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:19.605696 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c68098-a7c4-4353-be95-83107e630338 None admin] RBAC: Authorizing `identity:get_user(user_id=2c1d625ee1a94e07b2529f87ccb757d0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:19.607124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c68098-a7c4-4353-be95-83107e630338 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:19.608798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 560/1103] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:19 2022] GET /identity/v3/users/2c1d625ee1a94e07b2529f87ccb757d0 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:19.614644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef953d7-80b8-4d7e-8060-22dce7af79dd None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:19.715838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef953d7-80b8-4d7e-8060-22dce7af79dd None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:19.761327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d409-a923-4eb5-887e-0f3b54287ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:19.762525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d409-a923-4eb5-887e-0f3b54287ec1 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:19.762810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d409-a923-4eb5-887e-0f3b54287ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:19.763106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d409-a923-4eb5-887e-0f3b54287ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:19.818236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:19.831797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0d409-a923-4eb5-887e-0f3b54287ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:19.833277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0d409-a923-4eb5-887e-0f3b54287ec1 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:19.930994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 544/1104] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:44:19.937508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c68098-a7c4-4353-be95-83107e630338 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:20.027209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:20.039250 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c68098-a7c4-4353-be95-83107e630338 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:20.077671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea138f3c-4abe-46b7-84eb-49f1d16f1743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:20.078719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea138f3c-4abe-46b7-84eb-49f1d16f1743 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:20.079000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea138f3c-4abe-46b7-84eb-49f1d16f1743 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:20.079273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea138f3c-4abe-46b7-84eb-49f1d16f1743 None admin] PATH_INFO: `/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:20.080527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea138f3c-4abe-46b7-84eb-49f1d16f1743 None admin] RBAC: Authorizing `identity:get_project(project_id=31fdc6f6b4bf48bd87407a2d96c687fd)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:20.083812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea138f3c-4abe-46b7-84eb-49f1d16f1743 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:20.084878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 561/1105] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:44:19 2022] GET /identity/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:20.089913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d409-a923-4eb5-887e-0f3b54287ec1 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:20.174558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:20.189602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d409-a923-4eb5-887e-0f3b54287ec1 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:20.224415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42a048-4470-47e7-bb1e-56a1370822ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:20.225155 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42a048-4470-47e7-bb1e-56a1370822ca None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:20.225666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42a048-4470-47e7-bb1e-56a1370822ca None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:20.226122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42a048-4470-47e7-bb1e-56a1370822ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:20.227320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42a048-4470-47e7-bb1e-56a1370822ca None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=31fdc6f6b4bf48bd87407a2d96c687fd, user.id=2c1d625ee1a94e07b2529f87ccb757d0) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:20.227658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42a048-4470-47e7-bb1e-56a1370822ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:20.229109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42a048-4470-47e7-bb1e-56a1370822ca None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:20.235881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 545/1106] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:44:20 2022] GET /identity/v3/role_assignments?user.id=2c1d625ee1a94e07b2529f87ccb757d0&scope.project.id=31fdc6f6b4bf48bd87407a2d96c687fd&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:22.536916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4896e78-f4d1-4098-9ffc-f172c9a63f14 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:22.537479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4896e78-f4d1-4098-9ffc-f172c9a63f14 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:22.537479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4896e78-f4d1-4098-9ffc-f172c9a63f14 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:22.538817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 562/1107] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:22.544402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaab43-56b3-4e8b-ae21-b969f59b7584 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:22.544840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaab43-56b3-4e8b-ae21-b969f59b7584 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:22.544962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaab43-56b3-4e8b-ae21-b969f59b7584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:22.561949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5bcaab43-56b3-4e8b-ae21-b969f59b7584 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:22.563122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5bcaab43-56b3-4e8b-ae21-b969f59b7584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:22.629535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 546/1108] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:22.655174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4896e78-f4d1-4098-9ffc-f172c9a63f14 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:22.756744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4896e78-f4d1-4098-9ffc-f172c9a63f14 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:22.789728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eec0ea-34b1-481b-8db6-e5423956e470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:22.790429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eec0ea-34b1-481b-8db6-e5423956e470 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:22.790709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eec0ea-34b1-481b-8db6-e5423956e470 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:22.790980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eec0ea-34b1-481b-8db6-e5423956e470 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:22.792161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eec0ea-34b1-481b-8db6-e5423956e470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:22.794150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eec0ea-34b1-481b-8db6-e5423956e470 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:22.795794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 563/1109] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:22.802610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaab43-56b3-4e8b-ae21-b969f59b7584 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:22.881488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:22.900416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaab43-56b3-4e8b-ae21-b969f59b7584 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:22.934460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823b691-dfcf-4594-b4ef-75f65874adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:22.935117 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b691-dfcf-4594-b4ef-75f65874adea None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:22.935402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b691-dfcf-4594-b4ef-75f65874adea None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:22.935706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b691-dfcf-4594-b4ef-75f65874adea None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:22.936415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823b691-dfcf-4594-b4ef-75f65874adea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:22.937847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823b691-dfcf-4594-b4ef-75f65874adea None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:23.066505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 547/1110] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:44:22 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:25.319421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a522e22-b3e2-4f55-a886-cda717b24f38 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.320019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a522e22-b3e2-4f55-a886-cda717b24f38 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.320019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a522e22-b3e2-4f55-a886-cda717b24f38 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.321396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 564/1111] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:25.326942 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab3fb1-c07e-4bb4-94f1-c1f86d0b9b43 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.327385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab3fb1-c07e-4bb4-94f1-c1f86d0b9b43 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.327512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab3fb1-c07e-4bb4-94f1-c1f86d0b9b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.344626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-11ab3fb1-c07e-4bb4-94f1-c1f86d0b9b43 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:25.345827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-11ab3fb1-c07e-4bb4-94f1-c1f86d0b9b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:25.413368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 548/1112] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:25.439729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a522e22-b3e2-4f55-a886-cda717b24f38 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.469136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:25.546138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a522e22-b3e2-4f55-a886-cda717b24f38 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.579537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb5c1e-944b-4b75-bf19-923ee0117409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.580412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5c1e-944b-4b75-bf19-923ee0117409 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.580603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5c1e-944b-4b75-bf19-923ee0117409 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.580868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5c1e-944b-4b75-bf19-923ee0117409 None admin] PATH_INFO: `/v3/roles/0c702df8791a47cb89a43521d61e4f21` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.582338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb5c1e-944b-4b75-bf19-923ee0117409 None admin] RBAC: Authorizing `identity:get_role(role_id=0c702df8791a47cb89a43521d61e4f21)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.583726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb5c1e-944b-4b75-bf19-923ee0117409 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.585106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 565/1113] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:25 2022] GET /identity/v3/roles/0c702df8791a47cb89a43521d61e4f21 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:25.590988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab3fb1-c07e-4bb4-94f1-c1f86d0b9b43 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.656782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:25.692363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab3fb1-c07e-4bb4-94f1-c1f86d0b9b43 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.727823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33222b5-f97b-4b37-ae97-9723e2d6787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.728714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33222b5-f97b-4b37-ae97-9723e2d6787b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.728999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33222b5-f97b-4b37-ae97-9723e2d6787b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.729274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33222b5-f97b-4b37-ae97-9723e2d6787b None admin] PATH_INFO: `/v3/users/adb0c514a6f84fe8aa92060f8a2360d7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.744832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33222b5-f97b-4b37-ae97-9723e2d6787b None admin] RBAC: Authorizing `identity:get_user(user_id=adb0c514a6f84fe8aa92060f8a2360d7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.746359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33222b5-f97b-4b37-ae97-9723e2d6787b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.748106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 549/1114] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:25 2022] GET /identity/v3/users/adb0c514a6f84fe8aa92060f8a2360d7 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:25.753986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb5c1e-944b-4b75-bf19-923ee0117409 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:25.844676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:25.852918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb5c1e-944b-4b75-bf19-923ee0117409 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.886046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a212b8-b130-4bb7-a5d5-6e71bc2629a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.886714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a212b8-b130-4bb7-a5d5-6e71bc2629a9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.886993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a212b8-b130-4bb7-a5d5-6e71bc2629a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.887269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a212b8-b130-4bb7-a5d5-6e71bc2629a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:26.037257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a212b8-b130-4bb7-a5d5-6e71bc2629a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:26.038715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a212b8-b130-4bb7-a5d5-6e71bc2629a9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:26.132590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:26.142842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 566/1115] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:44:26.149312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33222b5-f97b-4b37-ae97-9723e2d6787b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:26.255625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33222b5-f97b-4b37-ae97-9723e2d6787b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:26.279574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:26.290054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f382-39e4-429c-93a8-d7df91b26ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:26.290902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f382-39e4-429c-93a8-d7df91b26ff3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:26.291184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f382-39e4-429c-93a8-d7df91b26ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:26.295416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f382-39e4-429c-93a8-d7df91b26ff3 None admin] PATH_INFO: `/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:26.295416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7f382-39e4-429c-93a8-d7df91b26ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=31fdc6f6b4bf48bd87407a2d96c687fd)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:26.295416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7f382-39e4-429c-93a8-d7df91b26ff3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:26.296480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 550/1116] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:44:26 2022] GET /identity/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:26.302748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a212b8-b130-4bb7-a5d5-6e71bc2629a9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:26.406728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a212b8-b130-4bb7-a5d5-6e71bc2629a9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:26.441025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f81e8-9a74-4359-b469-8cd8e4c15039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:26.441679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f81e8-9a74-4359-b469-8cd8e4c15039 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:26.441960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f81e8-9a74-4359-b469-8cd8e4c15039 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:26.442238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f81e8-9a74-4359-b469-8cd8e4c15039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:26.443073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f81e8-9a74-4359-b469-8cd8e4c15039 None admin] RBAC: Adding query filter params (role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=31fdc6f6b4bf48bd87407a2d96c687fd, user.id=adb0c514a6f84fe8aa92060f8a2360d7) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:26.443386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f81e8-9a74-4359-b469-8cd8e4c15039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:26.444981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f81e8-9a74-4359-b469-8cd8e4c15039 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:26.450851 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 567/1117] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:44:26 2022] GET /identity/v3/role_assignments?user.id=adb0c514a6f84fe8aa92060f8a2360d7&scope.project.id=31fdc6f6b4bf48bd87407a2d96c687fd&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:28.687444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c81b1c-c423-4167-b3de-46a6942f2619 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:28.688129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c81b1c-c423-4167-b3de-46a6942f2619 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:28.688129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c81b1c-c423-4167-b3de-46a6942f2619 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:28.689454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 551/1118] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:28.694752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1aeb-0320-4bde-9fee-ff963ccdd144 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:28.695134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1aeb-0320-4bde-9fee-ff963ccdd144 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:28.695297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1aeb-0320-4bde-9fee-ff963ccdd144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:28.713308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3fde1aeb-0320-4bde-9fee-ff963ccdd144 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:28.714490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3fde1aeb-0320-4bde-9fee-ff963ccdd144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:28.770340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:28.788135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 568/1119] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:28.825268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c81b1c-c423-4167-b3de-46a6942f2619 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:28.940582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c81b1c-c423-4167-b3de-46a6942f2619 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:28.979458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2384bef-81d3-45a5-bb85-0d105a013289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:28.980413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2384bef-81d3-45a5-bb85-0d105a013289 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:28.980738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2384bef-81d3-45a5-bb85-0d105a013289 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:28.981057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2384bef-81d3-45a5-bb85-0d105a013289 None admin] PATH_INFO: `/v3/roles/0c702df8791a47cb89a43521d61e4f21` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:28.982705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2384bef-81d3-45a5-bb85-0d105a013289 None admin] RBAC: Authorizing `identity:get_role(role_id=0c702df8791a47cb89a43521d61e4f21)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:28.984144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2384bef-81d3-45a5-bb85-0d105a013289 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:28.985655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 552/1120] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:28 2022] GET /identity/v3/roles/0c702df8791a47cb89a43521d61e4f21 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:28.992424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1aeb-0320-4bde-9fee-ff963ccdd144 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.092518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1aeb-0320-4bde-9fee-ff963ccdd144 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.134592 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd644880-5a9a-4fa1-abef-615084fce508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:29.135478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd644880-5a9a-4fa1-abef-615084fce508 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.135794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd644880-5a9a-4fa1-abef-615084fce508 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.136077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd644880-5a9a-4fa1-abef-615084fce508 None admin] PATH_INFO: `/v3/users/adb0c514a6f84fe8aa92060f8a2360d7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.137302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd644880-5a9a-4fa1-abef-615084fce508 None admin] RBAC: Authorizing `identity:get_user(user_id=adb0c514a6f84fe8aa92060f8a2360d7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:29.138757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd644880-5a9a-4fa1-abef-615084fce508 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.140459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 569/1121] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:28 2022] GET /identity/v3/users/adb0c514a6f84fe8aa92060f8a2360d7 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:29.146242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2384bef-81d3-45a5-bb85-0d105a013289 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.212852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:29.257460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2384bef-81d3-45a5-bb85-0d105a013289 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.295119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afab3e-ade1-4aa9-be79-c24ea673f06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:29.296030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afab3e-ade1-4aa9-be79-c24ea673f06c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.296351 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afab3e-ade1-4aa9-be79-c24ea673f06c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.296572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afab3e-ade1-4aa9-be79-c24ea673f06c None admin] PATH_INFO: `/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.297885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afab3e-ade1-4aa9-be79-c24ea673f06c None admin] RBAC: Authorizing `identity:get_project(project_id=31fdc6f6b4bf48bd87407a2d96c687fd)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:29.299357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afab3e-ade1-4aa9-be79-c24ea673f06c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.301184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 553/1122] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:44:29 2022] GET /identity/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:29.307504 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd644880-5a9a-4fa1-abef-615084fce508 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.370225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:29.417401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd644880-5a9a-4fa1-abef-615084fce508 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.455264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39e908-4854-4873-8877-4cf3aecf4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:29.456186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39e908-4854-4873-8877-4cf3aecf4b05 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.456471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39e908-4854-4873-8877-4cf3aecf4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.456746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39e908-4854-4873-8877-4cf3aecf4b05 None admin] PATH_INFO: `/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd/users/adb0c514a6f84fe8aa92060f8a2360d7/roles/0c702df8791a47cb89a43521d61e4f21` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.459200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39e908-4854-4873-8877-4cf3aecf4b05 None admin] RBAC: Authorizing `identity:create_grant(project_id=31fdc6f6b4bf48bd87407a2d96c687fd, user_id=adb0c514a6f84fe8aa92060f8a2360d7, role_id=0c702df8791a47cb89a43521d61e4f21)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:29.460695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39e908-4854-4873-8877-4cf3aecf4b05 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.552859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 570/1123] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:44:29 2022] PUT /identity/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd/users/adb0c514a6f84fe8aa92060f8a2360d7/roles/0c702df8791a47cb89a43521d61e4f21 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:31.795046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a07973-1232-48ae-be20-583ca3125dfc None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:31.795590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a07973-1232-48ae-be20-583ca3125dfc None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:31.795687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a07973-1232-48ae-be20-583ca3125dfc None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:31.797003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 554/1124] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:31.805697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a26c-5460-46ea-a108-16c2f52bba40 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:31.806173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a26c-5460-46ea-a108-16c2f52bba40 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:31.806316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a26c-5460-46ea-a108-16c2f52bba40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:31.823506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c5c0a26c-5460-46ea-a108-16c2f52bba40 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:31.825330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c5c0a26c-5460-46ea-a108-16c2f52bba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:31.893946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 571/1125] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:31.917554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a07973-1232-48ae-be20-583ca3125dfc None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:32.028530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a07973-1232-48ae-be20-583ca3125dfc None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:32.056709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:32.065256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50758220-2628-4020-ba14-2cfec56e93e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:32.066117 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50758220-2628-4020-ba14-2cfec56e93e3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:32.066403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50758220-2628-4020-ba14-2cfec56e93e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:32.066683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50758220-2628-4020-ba14-2cfec56e93e3 None admin] PATH_INFO: `/v3/roles/0c702df8791a47cb89a43521d61e4f21` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:32.068229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50758220-2628-4020-ba14-2cfec56e93e3 None admin] RBAC: Authorizing `identity:get_role(role_id=0c702df8791a47cb89a43521d61e4f21)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:32.071096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50758220-2628-4020-ba14-2cfec56e93e3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:32.071096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 555/1126] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:31 2022] GET /identity/v3/roles/0c702df8791a47cb89a43521d61e4f21 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:32.077609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a26c-5460-46ea-a108-16c2f52bba40 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:32.127866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:32.181328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a26c-5460-46ea-a108-16c2f52bba40 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:32.217334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644632c8-8e16-4251-b2c3-fb0533807c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:32.218478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644632c8-8e16-4251-b2c3-fb0533807c44 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:32.218789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644632c8-8e16-4251-b2c3-fb0533807c44 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:32.219065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644632c8-8e16-4251-b2c3-fb0533807c44 None admin] PATH_INFO: `/v3/users/adb0c514a6f84fe8aa92060f8a2360d7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:32.220446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644632c8-8e16-4251-b2c3-fb0533807c44 None admin] RBAC: Authorizing `identity:get_user(user_id=adb0c514a6f84fe8aa92060f8a2360d7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:32.221916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644632c8-8e16-4251-b2c3-fb0533807c44 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:32.223765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 572/1127] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:32 2022] GET /identity/v3/users/adb0c514a6f84fe8aa92060f8a2360d7 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:32.230097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50758220-2628-4020-ba14-2cfec56e93e3 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:32.336711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50758220-2628-4020-ba14-2cfec56e93e3 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:32.370693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2cc99-c937-4d19-baf6-ef45ac77b7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:32.371940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2cc99-c937-4d19-baf6-ef45ac77b7cb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:32.372221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2cc99-c937-4d19-baf6-ef45ac77b7cb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:32.372491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2cc99-c937-4d19-baf6-ef45ac77b7cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:32.435390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:32.442080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2cc99-c937-4d19-baf6-ef45ac77b7cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:32.443579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2cc99-c937-4d19-baf6-ef45ac77b7cb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:32.543847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 556/1128] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:44:32.550180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644632c8-8e16-4251-b2c3-fb0533807c44 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:32.651761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644632c8-8e16-4251-b2c3-fb0533807c44 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:32.665035 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:32.687418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24e54b-1e2b-43ca-84bd-136a6366feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:32.691884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e54b-1e2b-43ca-84bd-136a6366feb7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:32.691884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e54b-1e2b-43ca-84bd-136a6366feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:32.691884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e54b-1e2b-43ca-84bd-136a6366feb7 None admin] PATH_INFO: `/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:32.691884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24e54b-1e2b-43ca-84bd-136a6366feb7 None admin] RBAC: Authorizing `identity:get_project(project_id=31fdc6f6b4bf48bd87407a2d96c687fd)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:32.691884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24e54b-1e2b-43ca-84bd-136a6366feb7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:32.693192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 573/1129] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:44:32 2022] GET /identity/v3/projects/31fdc6f6b4bf48bd87407a2d96c687fd => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:32.699292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2cc99-c937-4d19-baf6-ef45ac77b7cb None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:32.797989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:32.804050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2cc99-c937-4d19-baf6-ef45ac77b7cb None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:32.839718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9adf1e-0bc0-4d04-8f2c-11c045cffdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:32.840532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9adf1e-0bc0-4d04-8f2c-11c045cffdc2 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:32.841161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9adf1e-0bc0-4d04-8f2c-11c045cffdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:32.841439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9adf1e-0bc0-4d04-8f2c-11c045cffdc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:32.842516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9adf1e-0bc0-4d04-8f2c-11c045cffdc2 None admin] RBAC: Adding query filter params (role.id=0c702df8791a47cb89a43521d61e4f21, scope.project.id=31fdc6f6b4bf48bd87407a2d96c687fd, user.id=adb0c514a6f84fe8aa92060f8a2360d7) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:32.842772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9adf1e-0bc0-4d04-8f2c-11c045cffdc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:32.844520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9adf1e-0bc0-4d04-8f2c-11c045cffdc2 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:32.850721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 557/1130] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:44:32 2022] GET /identity/v3/role_assignments?user.id=adb0c514a6f84fe8aa92060f8a2360d7&scope.project.id=31fdc6f6b4bf48bd87407a2d96c687fd&role.id=0c702df8791a47cb89a43521d61e4f21 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:35.159073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0dde9-e534-49a2-a30d-f80090c8426b None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:35.159643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0dde9-e534-49a2-a30d-f80090c8426b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:35.159643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0dde9-e534-49a2-a30d-f80090c8426b None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:35.160944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 574/1131] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:44:35.166631 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec21a9-005b-49be-9e6d-a2f4357836bb None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:35.167104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec21a9-005b-49be-9e6d-a2f4357836bb None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:35.167221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec21a9-005b-49be-9e6d-a2f4357836bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:35.186399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-bbec21a9-005b-49be-9e6d-a2f4357836bb None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:35.187746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bbec21a9-005b-49be-9e6d-a2f4357836bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:35.263148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 558/1132] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:35.287177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0dde9-e534-49a2-a30d-f80090c8426b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:35.391601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0dde9-e534-49a2-a30d-f80090c8426b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:35.432859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc823ff6-7431-4fb9-a820-c9b7a0139182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:35.433596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc823ff6-7431-4fb9-a820-c9b7a0139182 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:35.433878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc823ff6-7431-4fb9-a820-c9b7a0139182 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:35.434153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc823ff6-7431-4fb9-a820-c9b7a0139182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:35.435353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc823ff6-7431-4fb9-a820-c9b7a0139182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:35.436821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc823ff6-7431-4fb9-a820-c9b7a0139182 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:35.438456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 575/1133] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:35.444501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec21a9-005b-49be-9e6d-a2f4357836bb None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:35.542694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:35.553599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec21a9-005b-49be-9e6d-a2f4357836bb None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:35.590918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baf89f-6a7d-419a-9914-0e88d3eb7fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:35.591610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf89f-6a7d-419a-9914-0e88d3eb7fb3 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:35.591890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf89f-6a7d-419a-9914-0e88d3eb7fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:35.592160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf89f-6a7d-419a-9914-0e88d3eb7fb3 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:35.592883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baf89f-6a7d-419a-9914-0e88d3eb7fb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:35.594578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baf89f-6a7d-419a-9914-0e88d3eb7fb3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:35.738158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 559/1134] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:44:35 2022] POST /identity/v3/projects => generated 311 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:38.148606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697169c-468f-4215-94b8-c5c9ef4ffcb3 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.149154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697169c-468f-4215-94b8-c5c9ef4ffcb3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.149154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697169c-468f-4215-94b8-c5c9ef4ffcb3 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.150495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 576/1135] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:38.156564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9da5fc-99e7-44e6-8d0d-9bce5f43fea6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.157052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9da5fc-99e7-44e6-8d0d-9bce5f43fea6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.157210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9da5fc-99e7-44e6-8d0d-9bce5f43fea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.174100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-dc9da5fc-99e7-44e6-8d0d-9bce5f43fea6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:38.175286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-dc9da5fc-99e7-44e6-8d0d-9bce5f43fea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.243771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 560/1136] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:38.269217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697169c-468f-4215-94b8-c5c9ef4ffcb3 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:38.322789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:38.376541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697169c-468f-4215-94b8-c5c9ef4ffcb3 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:38.415339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473469b1-c47a-4cb9-9a72-e611e4575326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:38.416154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473469b1-c47a-4cb9-9a72-e611e4575326 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.416436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473469b1-c47a-4cb9-9a72-e611e4575326 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.416714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473469b1-c47a-4cb9-9a72-e611e4575326 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.418118 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473469b1-c47a-4cb9-9a72-e611e4575326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:38.419676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473469b1-c47a-4cb9-9a72-e611e4575326 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:38.421479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 577/1137] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:44:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:38.427780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9da5fc-99e7-44e6-8d0d-9bce5f43fea6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:38.505777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:38.538278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9da5fc-99e7-44e6-8d0d-9bce5f43fea6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:38.577634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e470cc-abbe-456f-a223-5dd60b3e4e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:38.578841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e470cc-abbe-456f-a223-5dd60b3e4e7d None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.579327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e470cc-abbe-456f-a223-5dd60b3e4e7d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.579702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e470cc-abbe-456f-a223-5dd60b3e4e7d None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.580846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e470cc-abbe-456f-a223-5dd60b3e4e7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:38.583011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e470cc-abbe-456f-a223-5dd60b3e4e7d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:38.690594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 561/1138] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:44:38 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:40.990494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b10f99-0a99-4858-8a09-f3615a6ad43f None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:40.991066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b10f99-0a99-4858-8a09-f3615a6ad43f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:40.991171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b10f99-0a99-4858-8a09-f3615a6ad43f None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:40.993378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 578/1139] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:41.000082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58114c04-0e69-4b56-863e-af79805f5587 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.000584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58114c04-0e69-4b56-863e-af79805f5587 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.006336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58114c04-0e69-4b56-863e-af79805f5587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.019641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-58114c04-0e69-4b56-863e-af79805f5587 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:41.020868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-58114c04-0e69-4b56-863e-af79805f5587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:41.096487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 562/1140] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:44:41.121522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b10f99-0a99-4858-8a09-f3615a6ad43f None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.241835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b10f99-0a99-4858-8a09-f3615a6ad43f None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.259755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:41.289219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6eba25-e904-4764-a527-49ff7f5522e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.290535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eba25-e904-4764-a527-49ff7f5522e7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.291022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eba25-e904-4764-a527-49ff7f5522e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.291532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eba25-e904-4764-a527-49ff7f5522e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.310430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6eba25-e904-4764-a527-49ff7f5522e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-eb6eba25-e904-4764-a527-49ff7f5522e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:44:41.325449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:41.327507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:41.329476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 579/1141] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:44:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:41.334096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58114c04-0e69-4b56-863e-af79805f5587 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.405214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:41.448612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58114c04-0e69-4b56-863e-af79805f5587 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.486220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f96ee8-2e8a-4bf9-9f0d-4188cf2060c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.486977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f96ee8-2e8a-4bf9-9f0d-4188cf2060c0 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.487319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f96ee8-2e8a-4bf9-9f0d-4188cf2060c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.487704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f96ee8-2e8a-4bf9-9f0d-4188cf2060c0 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.488512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f96ee8-2e8a-4bf9-9f0d-4188cf2060c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:41.488862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f96ee8-2e8a-4bf9-9f0d-4188cf2060c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.490352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f96ee8-2e8a-4bf9-9f0d-4188cf2060c0 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.499478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 563/1142] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:44:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:41.505388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6eba25-e904-4764-a527-49ff7f5522e7 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.614410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6eba25-e904-4764-a527-49ff7f5522e7 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.650984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e690c6-f29d-41b5-a99b-f832b81aa9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.652418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e690c6-f29d-41b5-a99b-f832b81aa9a0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.652700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e690c6-f29d-41b5-a99b-f832b81aa9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.652971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e690c6-f29d-41b5-a99b-f832b81aa9a0 None admin] PATH_INFO: `/v3/users/15a28954fc444715960ff9f6140fb7e5` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.668825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e690c6-f29d-41b5-a99b-f832b81aa9a0 None admin] RBAC: Authorizing `identity:get_user(user_id=15a28954fc444715960ff9f6140fb7e5)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.670356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e690c6-f29d-41b5-a99b-f832b81aa9a0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.672162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 580/1143] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:41 2022] GET /identity/v3/users/15a28954fc444715960ff9f6140fb7e5 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:41.679232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f96ee8-2e8a-4bf9-9f0d-4188cf2060c0 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.781266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f96ee8-2e8a-4bf9-9f0d-4188cf2060c0 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.802102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:41.815844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e320aa-bc91-4fe5-bc51-02038a8cba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.816486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e320aa-bc91-4fe5-bc51-02038a8cba2e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.816765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e320aa-bc91-4fe5-bc51-02038a8cba2e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.817036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e320aa-bc91-4fe5-bc51-02038a8cba2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.889771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e320aa-bc91-4fe5-bc51-02038a8cba2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.891222 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e320aa-bc91-4fe5-bc51-02038a8cba2e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:42.001169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 564/1144] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:44:42.007172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e690c6-f29d-41b5-a99b-f832b81aa9a0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:42.055074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:42.129295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e690c6-f29d-41b5-a99b-f832b81aa9a0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:42.168597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc3aa9-0cb9-4f66-aeee-31e4d57a4983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:42.169469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3aa9-0cb9-4f66-aeee-31e4d57a4983 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:42.169905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3aa9-0cb9-4f66-aeee-31e4d57a4983 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:42.170096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3aa9-0cb9-4f66-aeee-31e4d57a4983 None admin] PATH_INFO: `/v3/projects/29da3dc180674ba58ebbe1c41ca304e1` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:42.171635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc3aa9-0cb9-4f66-aeee-31e4d57a4983 None admin] RBAC: Authorizing `identity:get_project(project_id=29da3dc180674ba58ebbe1c41ca304e1)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:42.173102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc3aa9-0cb9-4f66-aeee-31e4d57a4983 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:42.174878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 581/1145] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:44:42 2022] GET /identity/v3/projects/29da3dc180674ba58ebbe1c41ca304e1 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:42.181645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e320aa-bc91-4fe5-bc51-02038a8cba2e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:42.205249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:42.294842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e320aa-bc91-4fe5-bc51-02038a8cba2e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:42.333189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a4fe0-8435-43e8-91cb-2d26f8b80608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:42.333784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a4fe0-8435-43e8-91cb-2d26f8b80608 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:42.334046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a4fe0-8435-43e8-91cb-2d26f8b80608 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:42.334321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a4fe0-8435-43e8-91cb-2d26f8b80608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:42.335157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a4fe0-8435-43e8-91cb-2d26f8b80608 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=29da3dc180674ba58ebbe1c41ca304e1, user.id=15a28954fc444715960ff9f6140fb7e5) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:42.335468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a4fe0-8435-43e8-91cb-2d26f8b80608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:42.336956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a4fe0-8435-43e8-91cb-2d26f8b80608 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:42.343707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 565/1146] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:44:42 2022] GET /identity/v3/role_assignments?user.id=15a28954fc444715960ff9f6140fb7e5&scope.project.id=29da3dc180674ba58ebbe1c41ca304e1&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:44.621163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdcaed-5fde-443a-af93-2bffb9ce3b9a None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:44.621753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdcaed-5fde-443a-af93-2bffb9ce3b9a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:44.621753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdcaed-5fde-443a-af93-2bffb9ce3b9a None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:44.623082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 582/1147] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:44.629615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbc06-b36f-4fd1-9b2a-26bffb21856c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:44.630161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbc06-b36f-4fd1-9b2a-26bffb21856c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:44.630585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbc06-b36f-4fd1-9b2a-26bffb21856c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:44.655348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a59cbc06-b36f-4fd1-9b2a-26bffb21856c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:44.656656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a59cbc06-b36f-4fd1-9b2a-26bffb21856c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:44.733637 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 566/1148] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:44.757158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdcaed-5fde-443a-af93-2bffb9ce3b9a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:44.866814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdcaed-5fde-443a-af93-2bffb9ce3b9a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:44.868573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:44.906072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa59262-6c00-4936-8009-00f2b93eb336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:44.906835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa59262-6c00-4936-8009-00f2b93eb336 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:44.907163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa59262-6c00-4936-8009-00f2b93eb336 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:44.907482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa59262-6c00-4936-8009-00f2b93eb336 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:44.919340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa59262-6c00-4936-8009-00f2b93eb336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-caa59262-6c00-4936-8009-00f2b93eb336 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:44:44.927914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:44.929803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:44.931159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 583/1149] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:44.937418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cbc06-b36f-4fd1-9b2a-26bffb21856c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:44.953067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:45.041845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cbc06-b36f-4fd1-9b2a-26bffb21856c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:45.080261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cfefa-a041-4786-91d8-db03e9b193d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:45.080930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cfefa-a041-4786-91d8-db03e9b193d2 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:45.081212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cfefa-a041-4786-91d8-db03e9b193d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:45.081487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cfefa-a041-4786-91d8-db03e9b193d2 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:45.082229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cfefa-a041-4786-91d8-db03e9b193d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:45.082534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cfefa-a041-4786-91d8-db03e9b193d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:45.084072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cfefa-a041-4786-91d8-db03e9b193d2 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:45.093963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 567/1150] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:44:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:45.100496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa59262-6c00-4936-8009-00f2b93eb336 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:45.213278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa59262-6c00-4936-8009-00f2b93eb336 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:45.256904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0470-5ab5-4d85-bcca-1ebd9873f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:45.257774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0470-5ab5-4d85-bcca-1ebd9873f911 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:45.258050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0470-5ab5-4d85-bcca-1ebd9873f911 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:45.258321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0470-5ab5-4d85-bcca-1ebd9873f911 None admin] PATH_INFO: `/v3/users/15a28954fc444715960ff9f6140fb7e5` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:45.259618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0470-5ab5-4d85-bcca-1ebd9873f911 None admin] RBAC: Authorizing `identity:get_user(user_id=15a28954fc444715960ff9f6140fb7e5)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:45.261214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0470-5ab5-4d85-bcca-1ebd9873f911 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:45.263013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 584/1151] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:45 2022] GET /identity/v3/users/15a28954fc444715960ff9f6140fb7e5 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:45.272668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cfefa-a041-4786-91d8-db03e9b193d2 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:45.396791 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:45.425542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cfefa-a041-4786-91d8-db03e9b193d2 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:45.468751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf851dca-ae59-4738-89e4-bd416bc31cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:45.469522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf851dca-ae59-4738-89e4-bd416bc31cc7 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:45.469891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf851dca-ae59-4738-89e4-bd416bc31cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:45.470246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf851dca-ae59-4738-89e4-bd416bc31cc7 None admin] PATH_INFO: `/v3/projects/29da3dc180674ba58ebbe1c41ca304e1` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:45.471592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf851dca-ae59-4738-89e4-bd416bc31cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=29da3dc180674ba58ebbe1c41ca304e1)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:45.473092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf851dca-ae59-4738-89e4-bd416bc31cc7 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:45.474958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 568/1152] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:44:45 2022] GET /identity/v3/projects/29da3dc180674ba58ebbe1c41ca304e1 => generated 311 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:45.481884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0470-5ab5-4d85-bcca-1ebd9873f911 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:45.521525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:45.607206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0470-5ab5-4d85-bcca-1ebd9873f911 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:45.644526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be56ef-b2c1-458b-a260-66d1e0cdd067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:45.645464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be56ef-b2c1-458b-a260-66d1e0cdd067 None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:45.645787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be56ef-b2c1-458b-a260-66d1e0cdd067 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:45.646096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be56ef-b2c1-458b-a260-66d1e0cdd067 None admin] PATH_INFO: `/v3/projects/29da3dc180674ba58ebbe1c41ca304e1/users/15a28954fc444715960ff9f6140fb7e5/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:45.648137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be56ef-b2c1-458b-a260-66d1e0cdd067 None admin] RBAC: Authorizing `identity:create_grant(project_id=29da3dc180674ba58ebbe1c41ca304e1, user_id=15a28954fc444715960ff9f6140fb7e5, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:45.649617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be56ef-b2c1-458b-a260-66d1e0cdd067 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:45.809786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 585/1153] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:44:45 2022] PUT /identity/v3/projects/29da3dc180674ba58ebbe1c41ca304e1/users/15a28954fc444715960ff9f6140fb7e5/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:48.121517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816075-a992-4e7e-8413-ad6ea972dec7 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.122040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816075-a992-4e7e-8413-ad6ea972dec7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.122040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816075-a992-4e7e-8413-ad6ea972dec7 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.123354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 569/1154] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:48.128962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba30ed-6417-4427-a4fb-9bcd660a7ca9 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.129465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba30ed-6417-4427-a4fb-9bcd660a7ca9 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.129606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba30ed-6417-4427-a4fb-9bcd660a7ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.146288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-98ba30ed-6417-4427-a4fb-9bcd660a7ca9 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:48.147483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-98ba30ed-6417-4427-a4fb-9bcd660a7ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:48.216939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 586/1155] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:48.241551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d816075-a992-4e7e-8413-ad6ea972dec7 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.351702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d816075-a992-4e7e-8413-ad6ea972dec7 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.389193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adedd2-7453-43c2-aab4-8c7656281872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.389900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adedd2-7453-43c2-aab4-8c7656281872 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.390409 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adedd2-7453-43c2-aab4-8c7656281872 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.390917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adedd2-7453-43c2-aab4-8c7656281872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.405732 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adedd2-7453-43c2-aab4-8c7656281872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-72adedd2-7453-43c2-aab4-8c7656281872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:44:48.413783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:48.415496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:44:48.416651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 570/1156] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:48.424078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba30ed-6417-4427-a4fb-9bcd660a7ca9 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.446414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:48.547694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba30ed-6417-4427-a4fb-9bcd660a7ca9 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.584644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749714-50ca-4a1f-98e4-6bccc8e0ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.585329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749714-50ca-4a1f-98e4-6bccc8e0ffeb None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.585608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749714-50ca-4a1f-98e4-6bccc8e0ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.585880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749714-50ca-4a1f-98e4-6bccc8e0ffeb None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.586618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749714-50ca-4a1f-98e4-6bccc8e0ffeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:48.586919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749714-50ca-4a1f-98e4-6bccc8e0ffeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:48.588336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749714-50ca-4a1f-98e4-6bccc8e0ffeb None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:48.598619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 587/1157] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:48.607852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adedd2-7453-43c2-aab4-8c7656281872 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.612992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:48.719432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adedd2-7453-43c2-aab4-8c7656281872 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.754350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e65e8-7064-401c-9863-6de2d01e2d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.755220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e65e8-7064-401c-9863-6de2d01e2d34 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.755507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e65e8-7064-401c-9863-6de2d01e2d34 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.755819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e65e8-7064-401c-9863-6de2d01e2d34 None admin] PATH_INFO: `/v3/users/15a28954fc444715960ff9f6140fb7e5` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.757051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e65e8-7064-401c-9863-6de2d01e2d34 None admin] RBAC: Authorizing `identity:get_user(user_id=15a28954fc444715960ff9f6140fb7e5)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:48.758518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e65e8-7064-401c-9863-6de2d01e2d34 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:48.760316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 571/1158] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:44:48 2022] GET /identity/v3/users/15a28954fc444715960ff9f6140fb7e5 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:48.766734 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749714-50ca-4a1f-98e4-6bccc8e0ffeb None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:48.853777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:48.873004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749714-50ca-4a1f-98e4-6bccc8e0ffeb None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:48.911267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132845-8ee0-4193-b593-bc1985cdf93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:48.911961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132845-8ee0-4193-b593-bc1985cdf93a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.912245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132845-8ee0-4193-b593-bc1985cdf93a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.912522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132845-8ee0-4193-b593-bc1985cdf93a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.985337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c132845-8ee0-4193-b593-bc1985cdf93a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:48.986813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c132845-8ee0-4193-b593-bc1985cdf93a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:49.072222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:49.104453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 588/1159] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:44:49.110767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e65e8-7064-401c-9863-6de2d01e2d34 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:49.189785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:49.224258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e65e8-7064-401c-9863-6de2d01e2d34 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:49.265916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea85fe-6002-4f8c-b9ab-994ee1d50892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:49.266744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea85fe-6002-4f8c-b9ab-994ee1d50892 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:49.267022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea85fe-6002-4f8c-b9ab-994ee1d50892 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:49.267335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea85fe-6002-4f8c-b9ab-994ee1d50892 None admin] PATH_INFO: `/v3/projects/29da3dc180674ba58ebbe1c41ca304e1` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:49.268694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea85fe-6002-4f8c-b9ab-994ee1d50892 None admin] RBAC: Authorizing `identity:get_project(project_id=29da3dc180674ba58ebbe1c41ca304e1)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:49.270333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea85fe-6002-4f8c-b9ab-994ee1d50892 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:49.272351 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 572/1160] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:44:49 2022] GET /identity/v3/projects/29da3dc180674ba58ebbe1c41ca304e1 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:49.279305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132845-8ee0-4193-b593-bc1985cdf93a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:49.394216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132845-8ee0-4193-b593-bc1985cdf93a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:49.430366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352cff6-229b-4e3f-ac1d-f79a51f9e5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:49.431024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352cff6-229b-4e3f-ac1d-f79a51f9e5d3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:49.431301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352cff6-229b-4e3f-ac1d-f79a51f9e5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:49.431593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352cff6-229b-4e3f-ac1d-f79a51f9e5d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:49.432446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352cff6-229b-4e3f-ac1d-f79a51f9e5d3 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=29da3dc180674ba58ebbe1c41ca304e1, user.id=15a28954fc444715960ff9f6140fb7e5) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:49.432793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352cff6-229b-4e3f-ac1d-f79a51f9e5d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:49.434950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352cff6-229b-4e3f-ac1d-f79a51f9e5d3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:49.442398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 589/1161] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:44:49 2022] GET /identity/v3/role_assignments?user.id=15a28954fc444715960ff9f6140fb7e5&scope.project.id=29da3dc180674ba58ebbe1c41ca304e1&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:44:51.725835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3c4b-ab3d-4008-811f-723b91a311d6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:51.726379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3c4b-ab3d-4008-811f-723b91a311d6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:51.726379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3c4b-ab3d-4008-811f-723b91a311d6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:51.727857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 573/1162] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:51.733898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9bfdf-a63a-4004-949b-8f5e47d78df7 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:51.734407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9bfdf-a63a-4004-949b-8f5e47d78df7 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:51.734510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9bfdf-a63a-4004-949b-8f5e47d78df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:51.751693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4db9bfdf-a63a-4004-949b-8f5e47d78df7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:51.752897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4db9bfdf-a63a-4004-949b-8f5e47d78df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:51.799090 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:51.823196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 590/1163] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:51.847025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a3c4b-ab3d-4008-811f-723b91a311d6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:51.954781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a3c4b-ab3d-4008-811f-723b91a311d6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:51.990589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e8b8f-c967-42ec-8819-99294182f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:51.991227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8b8f-c967-42ec-8819-99294182f5de None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:51.991506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8b8f-c967-42ec-8819-99294182f5de None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:51.991827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8b8f-c967-42ec-8819-99294182f5de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:52.003580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:52.065677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e8b8f-c967-42ec-8819-99294182f5de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:52.067160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e8b8f-c967-42ec-8819-99294182f5de None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:52.168358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 574/1164] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:44:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:44:52.174542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9bfdf-a63a-4004-949b-8f5e47d78df7 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:52.283002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9bfdf-a63a-4004-949b-8f5e47d78df7 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:52.320065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0814fa6-4892-4a8f-b412-7c2cd1306244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:52.320859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0814fa6-4892-4a8f-b412-7c2cd1306244 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:52.321138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0814fa6-4892-4a8f-b412-7c2cd1306244 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:52.321408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0814fa6-4892-4a8f-b412-7c2cd1306244 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:52.328665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0814fa6-4892-4a8f-b412-7c2cd1306244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:52.330116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0814fa6-4892-4a8f-b412-7c2cd1306244 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-b0814fa6-4892-4a8f-b412-7c2cd1306244 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:44:52.345168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:44:52.346313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:44:52.347248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 591/1165] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:44:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:44:52.352564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e8b8f-c967-42ec-8819-99294182f5de None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:52.399712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:52.460864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e8b8f-c967-42ec-8819-99294182f5de None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:52.503278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5e5df-dad8-4572-893d-47ebb9aaf4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:52.504051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5e5df-dad8-4572-893d-47ebb9aaf4cb None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:52.504387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5e5df-dad8-4572-893d-47ebb9aaf4cb None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:52.504667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5e5df-dad8-4572-893d-47ebb9aaf4cb None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:52.505400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5e5df-dad8-4572-893d-47ebb9aaf4cb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:52.505711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5e5df-dad8-4572-893d-47ebb9aaf4cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:52.507094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5e5df-dad8-4572-893d-47ebb9aaf4cb None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:52.515234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 575/1166] 10.222.0.93 () {56 vars in 1115 bytes} [Thu May 26 16:44:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:54.806743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754156f-be21-4b07-95ad-a0d849984e10 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:54.807523 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754156f-be21-4b07-95ad-a0d849984e10 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:54.807523 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754156f-be21-4b07-95ad-a0d849984e10 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:54.809332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 592/1167] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:54.814998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ce386-f631-4438-9772-0be21db29629 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:54.815494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ce386-f631-4438-9772-0be21db29629 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:54.815608 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ce386-f631-4438-9772-0be21db29629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:54.833979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-975ce386-f631-4438-9772-0be21db29629 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:54.835296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-975ce386-f631-4438-9772-0be21db29629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:54.907344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 576/1168] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:54.930714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754156f-be21-4b07-95ad-a0d849984e10 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:54.968449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:55.037210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754156f-be21-4b07-95ad-a0d849984e10 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:55.073081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29667a1-b7fa-4554-b740-8dd8cc7f1d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:55.073759 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29667a1-b7fa-4554-b740-8dd8cc7f1d60 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:55.074037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29667a1-b7fa-4554-b740-8dd8cc7f1d60 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:55.074308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29667a1-b7fa-4554-b740-8dd8cc7f1d60 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:55.075062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29667a1-b7fa-4554-b740-8dd8cc7f1d60 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:55.076574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29667a1-b7fa-4554-b740-8dd8cc7f1d60 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:55.182415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 593/1169] 10.222.0.93 () {60 vars in 1138 bytes} [Thu May 26 16:44:54 2022] POST /identity/v3/domains => generated 267 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:57.457488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7307fd-1dc9-4792-8cae-207750c7c047 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:57.458053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7307fd-1dc9-4792-8cae-207750c7c047 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:57.458053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7307fd-1dc9-4792-8cae-207750c7c047 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:57.459592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 577/1170] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:57.466007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df4df-e06a-47e6-a038-06be84404068 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:57.466551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df4df-e06a-47e6-a038-06be84404068 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:57.466789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df4df-e06a-47e6-a038-06be84404068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:57.485165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-ba1df4df-e06a-47e6-a038-06be84404068 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:57.486366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ba1df4df-e06a-47e6-a038-06be84404068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:57.558429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 594/1171] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:44:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:44:57.583285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7307fd-1dc9-4792-8cae-207750c7c047 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:57.626279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:57.703833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7307fd-1dc9-4792-8cae-207750c7c047 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:57.743023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dcd73-13f8-4775-b131-7de0cbf3eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:57.743908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dcd73-13f8-4775-b131-7de0cbf3eb50 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:57.744238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dcd73-13f8-4775-b131-7de0cbf3eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:57.744561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dcd73-13f8-4775-b131-7de0cbf3eb50 None admin] PATH_INFO: `/v3/domains/f4a0a05b9f3f4d21b0a48a8e85b6ad5a` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:57.757321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dcd73-13f8-4775-b131-7de0cbf3eb50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f4a0a05b9f3f4d21b0a48a8e85b6ad5a)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:57.758881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dcd73-13f8-4775-b131-7de0cbf3eb50 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:57.760757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 578/1172] 10.222.0.93 () {56 vars in 1183 bytes} [Thu May 26 16:44:57 2022] GET /identity/v3/domains/f4a0a05b9f3f4d21b0a48a8e85b6ad5a => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:57.767084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df4df-e06a-47e6-a038-06be84404068 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:57.795748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:57.881020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df4df-e06a-47e6-a038-06be84404068 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:57.922259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa97e6-26de-495a-98f0-bf77415ff866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:57.922872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa97e6-26de-495a-98f0-bf77415ff866 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:57.923153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa97e6-26de-495a-98f0-bf77415ff866 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:57.923445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa97e6-26de-495a-98f0-bf77415ff866 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:57.924315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa97e6-26de-495a-98f0-bf77415ff866 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:57.925782 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa97e6-26de-495a-98f0-bf77415ff866 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:58.456962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 595/1173] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:44:57 2022] POST /identity/v3/projects => generated 361 bytes in 691 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:45:00.792951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7099-23a7-4eb3-b14e-fd5b491f046d None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:00.793552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7099-23a7-4eb3-b14e-fd5b491f046d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:00.793552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7099-23a7-4eb3-b14e-fd5b491f046d None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:00.795106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 579/1174] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:00.801018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582225c-7951-42f4-a8e6-901ccddaed49 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:00.801455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582225c-7951-42f4-a8e6-901ccddaed49 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:00.801655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582225c-7951-42f4-a8e6-901ccddaed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:00.820340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-0582225c-7951-42f4-a8e6-901ccddaed49 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:00.821671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-0582225c-7951-42f4-a8e6-901ccddaed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:00.900563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 596/1175] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:45:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:45:00.928601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7099-23a7-4eb3-b14e-fd5b491f046d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:01.033961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:01.042271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7099-23a7-4eb3-b14e-fd5b491f046d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:01.082017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81240292-d569-45e5-b118-b987a3641869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:01.082931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81240292-d569-45e5-b118-b987a3641869 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:01.083320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81240292-d569-45e5-b118-b987a3641869 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:01.083716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81240292-d569-45e5-b118-b987a3641869 None admin] PATH_INFO: `/v3/domains/f4a0a05b9f3f4d21b0a48a8e85b6ad5a` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:01.085145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81240292-d569-45e5-b118-b987a3641869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f4a0a05b9f3f4d21b0a48a8e85b6ad5a)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:01.086842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81240292-d569-45e5-b118-b987a3641869 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:01.089939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 580/1176] 10.222.0.93 () {56 vars in 1183 bytes} [Thu May 26 16:45:00 2022] GET /identity/v3/domains/f4a0a05b9f3f4d21b0a48a8e85b6ad5a => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:01.095533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582225c-7951-42f4-a8e6-901ccddaed49 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:01.106154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:01.199088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582225c-7951-42f4-a8e6-901ccddaed49 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:01.246581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948156e-fe72-4ef2-a02c-9af04973793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:01.247270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948156e-fe72-4ef2-a02c-9af04973793b None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:01.247556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948156e-fe72-4ef2-a02c-9af04973793b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:01.248035 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948156e-fe72-4ef2-a02c-9af04973793b None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:01.248761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948156e-fe72-4ef2-a02c-9af04973793b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:01.250204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948156e-fe72-4ef2-a02c-9af04973793b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:01.424565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 597/1177] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:45:01 2022] POST /identity/v3/users => generated 311 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:45:03.791861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46913330-aa01-4b84-af79-3c977de8215d None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:03.792947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46913330-aa01-4b84-af79-3c977de8215d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:03.792947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46913330-aa01-4b84-af79-3c977de8215d None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:03.794341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 581/1178] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:03.800039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a968af-e81f-4dd2-ada3-75e24eb95644 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:03.800477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a968af-e81f-4dd2-ada3-75e24eb95644 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:03.800597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a968af-e81f-4dd2-ada3-75e24eb95644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:03.817929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b9a968af-e81f-4dd2-ada3-75e24eb95644 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:03.819125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b9a968af-e81f-4dd2-ada3-75e24eb95644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:03.878906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:03.888462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 598/1179] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:45:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:45:03.912850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46913330-aa01-4b84-af79-3c977de8215d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:04.020929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46913330-aa01-4b84-af79-3c977de8215d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:04.055794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aa7a8-216b-4736-8c53-7d0005f4c6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:04.056580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa7a8-216b-4736-8c53-7d0005f4c6e6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:04.056863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa7a8-216b-4736-8c53-7d0005f4c6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:04.057142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa7a8-216b-4736-8c53-7d0005f4c6e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:04.067394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672aa7a8-216b-4736-8c53-7d0005f4c6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-672aa7a8-216b-4736-8c53-7d0005f4c6e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:45:04.075094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:45:04.076881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:45:04.078343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 582/1180] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:45:04.085163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a968af-e81f-4dd2-ada3-75e24eb95644 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:04.186644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a968af-e81f-4dd2-ada3-75e24eb95644 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:04.223585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8e6e0-8121-4233-9395-45360bf9c824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:04.226172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8e6e0-8121-4233-9395-45360bf9c824 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:04.226172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8e6e0-8121-4233-9395-45360bf9c824 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:04.226172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8e6e0-8121-4233-9395-45360bf9c824 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:04.226172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8e6e0-8121-4233-9395-45360bf9c824 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:45:04.226172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8e6e0-8121-4233-9395-45360bf9c824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:04.227264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8e6e0-8121-4233-9395-45360bf9c824 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:04.237940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 599/1181] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:04.246780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aa7a8-216b-4736-8c53-7d0005f4c6e6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:04.278523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:04.369161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aa7a8-216b-4736-8c53-7d0005f4c6e6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:04.405790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b5a1d-3210-468f-94df-96e23fbd39a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:04.406710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b5a1d-3210-468f-94df-96e23fbd39a4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:04.407033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b5a1d-3210-468f-94df-96e23fbd39a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:04.407348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b5a1d-3210-468f-94df-96e23fbd39a4 None admin] PATH_INFO: `/v3/users/fc872e8fccee46fcbab24d2ba78a65cc` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:04.421402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b5a1d-3210-468f-94df-96e23fbd39a4 None admin] RBAC: Authorizing `identity:get_user(user_id=fc872e8fccee46fcbab24d2ba78a65cc)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:04.422951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b5a1d-3210-468f-94df-96e23fbd39a4 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:04.424794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 583/1182] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:45:04 2022] GET /identity/v3/users/fc872e8fccee46fcbab24d2ba78a65cc => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:04.430837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8e6e0-8121-4233-9395-45360bf9c824 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:04.504689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:04.548662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8e6e0-8121-4233-9395-45360bf9c824 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:04.582362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05d40-1e5b-4aae-a5ad-e62354250b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:04.583010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05d40-1e5b-4aae-a5ad-e62354250b1d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:04.583289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05d40-1e5b-4aae-a5ad-e62354250b1d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:04.583578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05d40-1e5b-4aae-a5ad-e62354250b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:04.650621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb05d40-1e5b-4aae-a5ad-e62354250b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:04.652633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb05d40-1e5b-4aae-a5ad-e62354250b1d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:04.708232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:04.753113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 600/1183] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:45:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:45:04.759138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b5a1d-3210-468f-94df-96e23fbd39a4 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:04.849265 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:04.871125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b5a1d-3210-468f-94df-96e23fbd39a4 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:04.908322 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2fd34-b842-46b1-8767-bf74488700a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:04.909206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2fd34-b842-46b1-8767-bf74488700a4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:04.909491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2fd34-b842-46b1-8767-bf74488700a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:04.909766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2fd34-b842-46b1-8767-bf74488700a4 None admin] PATH_INFO: `/v3/projects/71685e4510964197a020d83cec48c8b0` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:04.911154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2fd34-b842-46b1-8767-bf74488700a4 None admin] RBAC: Authorizing `identity:get_project(project_id=71685e4510964197a020d83cec48c8b0)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:04.912782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2fd34-b842-46b1-8767-bf74488700a4 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:04.914644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 584/1184] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:45:04 2022] GET /identity/v3/projects/71685e4510964197a020d83cec48c8b0 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:04.921783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05d40-1e5b-4aae-a5ad-e62354250b1d None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:05.030876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05d40-1e5b-4aae-a5ad-e62354250b1d None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:05.067166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b0023-5a5c-43de-8726-3bae635b7d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:05.067849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b0023-5a5c-43de-8726-3bae635b7d45 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:05.068129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b0023-5a5c-43de-8726-3bae635b7d45 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:05.068392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b0023-5a5c-43de-8726-3bae635b7d45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:05.069226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b0023-5a5c-43de-8726-3bae635b7d45 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=71685e4510964197a020d83cec48c8b0, user.id=fc872e8fccee46fcbab24d2ba78a65cc) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:45:05.069527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b0023-5a5c-43de-8726-3bae635b7d45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:05.071030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b0023-5a5c-43de-8726-3bae635b7d45 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:05.078186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 601/1185] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:45:04 2022] GET /identity/v3/role_assignments?user.id=fc872e8fccee46fcbab24d2ba78a65cc&scope.project.id=71685e4510964197a020d83cec48c8b0&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:07.338995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e0acc-c3ce-49c5-bd2b-b55516f77f56 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:07.339525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e0acc-c3ce-49c5-bd2b-b55516f77f56 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:07.339689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e0acc-c3ce-49c5-bd2b-b55516f77f56 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:07.341088 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 585/1186] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:07.347264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfc34b-bb59-442e-8b01-7c11bf8b30ea None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:07.347796 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfc34b-bb59-442e-8b01-7c11bf8b30ea None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:07.347914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfc34b-bb59-442e-8b01-7c11bf8b30ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:07.365195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-acdfc34b-bb59-442e-8b01-7c11bf8b30ea None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:07.366382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-acdfc34b-bb59-442e-8b01-7c11bf8b30ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:07.381995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:07.438899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 602/1187] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:45:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:45:07.461952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e0acc-c3ce-49c5-bd2b-b55516f77f56 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:07.569614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e0acc-c3ce-49c5-bd2b-b55516f77f56 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:07.606387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9c976-4026-4082-9c38-1e0832e9145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:07.607095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9c976-4026-4082-9c38-1e0832e9145a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:07.607373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9c976-4026-4082-9c38-1e0832e9145a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:07.607679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9c976-4026-4082-9c38-1e0832e9145a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:07.618439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9c976-4026-4082-9c38-1e0832e9145a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-a3b9c976-4026-4082-9c38-1e0832e9145a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:45:07.626701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:45:07.627926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:45:07.628813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 586/1188] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:45:07.634268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfc34b-bb59-442e-8b01-7c11bf8b30ea None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:07.740889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfc34b-bb59-442e-8b01-7c11bf8b30ea None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:07.777278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf609-1fa7-40e0-a6c5-2206d043ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:07.777948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf609-1fa7-40e0-a6c5-2206d043ced2 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:07.778230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf609-1fa7-40e0-a6c5-2206d043ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:07.778505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf609-1fa7-40e0-a6c5-2206d043ced2 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:07.779259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebf609-1fa7-40e0-a6c5-2206d043ced2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:45:07.779594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebf609-1fa7-40e0-a6c5-2206d043ced2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:07.780955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebf609-1fa7-40e0-a6c5-2206d043ced2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:07.789652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 603/1189] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:07.800140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9c976-4026-4082-9c38-1e0832e9145a None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:07.819418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:07.954701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9c976-4026-4082-9c38-1e0832e9145a None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:07.990306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52301d0-7aac-43ca-991b-c60eb776c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:07.991207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52301d0-7aac-43ca-991b-c60eb776c18b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:07.991488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52301d0-7aac-43ca-991b-c60eb776c18b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:07.991789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52301d0-7aac-43ca-991b-c60eb776c18b None admin] PATH_INFO: `/v3/users/fc872e8fccee46fcbab24d2ba78a65cc` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:07.993000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52301d0-7aac-43ca-991b-c60eb776c18b None admin] RBAC: Authorizing `identity:get_user(user_id=fc872e8fccee46fcbab24d2ba78a65cc)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:07.994459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52301d0-7aac-43ca-991b-c60eb776c18b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:07.996196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 587/1190] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:45:07 2022] GET /identity/v3/users/fc872e8fccee46fcbab24d2ba78a65cc => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:08.002012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf609-1fa7-40e0-a6c5-2206d043ced2 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:08.018795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:08.116571 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf609-1fa7-40e0-a6c5-2206d043ced2 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:08.150419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615735c4-75d5-4696-8773-46869f33ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:08.151890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615735c4-75d5-4696-8773-46869f33ba7d None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:08.152172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615735c4-75d5-4696-8773-46869f33ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:08.152440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615735c4-75d5-4696-8773-46869f33ba7d None admin] PATH_INFO: `/v3/projects/71685e4510964197a020d83cec48c8b0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:08.153621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615735c4-75d5-4696-8773-46869f33ba7d None admin] RBAC: Authorizing `identity:get_project(project_id=71685e4510964197a020d83cec48c8b0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:08.155056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615735c4-75d5-4696-8773-46869f33ba7d None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:08.156910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 604/1191] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:45:08 2022] GET /identity/v3/projects/71685e4510964197a020d83cec48c8b0 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:08.163073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52301d0-7aac-43ca-991b-c60eb776c18b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:08.242837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:08.266151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52301d0-7aac-43ca-991b-c60eb776c18b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:08.302004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c461a18-9eda-4d10-9a97-2f7ee9929327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:08.302778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c461a18-9eda-4d10-9a97-2f7ee9929327 None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:08.304013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c461a18-9eda-4d10-9a97-2f7ee9929327 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:08.304013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c461a18-9eda-4d10-9a97-2f7ee9929327 None admin] PATH_INFO: `/v3/projects/71685e4510964197a020d83cec48c8b0/users/fc872e8fccee46fcbab24d2ba78a65cc/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:08.305559 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c461a18-9eda-4d10-9a97-2f7ee9929327 None admin] RBAC: Authorizing `identity:create_grant(project_id=71685e4510964197a020d83cec48c8b0, user_id=fc872e8fccee46fcbab24d2ba78a65cc, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:08.307082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c461a18-9eda-4d10-9a97-2f7ee9929327 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:08.383637 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 588/1192] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:45:08 2022] PUT /identity/v3/projects/71685e4510964197a020d83cec48c8b0/users/fc872e8fccee46fcbab24d2ba78a65cc/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:45:10.658589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59ecc-b335-40ca-b27d-c456acdf7819 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:10.659247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59ecc-b335-40ca-b27d-c456acdf7819 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:10.659247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59ecc-b335-40ca-b27d-c456acdf7819 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:10.660549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 605/1193] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:10.666188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41baa78-7a99-45d3-90f9-92c69c7b2ba3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:10.666642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41baa78-7a99-45d3-90f9-92c69c7b2ba3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:10.666773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41baa78-7a99-45d3-90f9-92c69c7b2ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:10.686332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b41baa78-7a99-45d3-90f9-92c69c7b2ba3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:10.687851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b41baa78-7a99-45d3-90f9-92c69c7b2ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:10.758156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 589/1194] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:45:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:45:10.782762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac59ecc-b335-40ca-b27d-c456acdf7819 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:10.873200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:10.895982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac59ecc-b335-40ca-b27d-c456acdf7819 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:10.935268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd25f-0054-4728-b659-bd5fd9a3283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:10.936180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd25f-0054-4728-b659-bd5fd9a3283b None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:10.936538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd25f-0054-4728-b659-bd5fd9a3283b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:10.936925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd25f-0054-4728-b659-bd5fd9a3283b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:10.949967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdd25f-0054-4728-b659-bd5fd9a3283b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-a2fdd25f-0054-4728-b659-bd5fd9a3283b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:45:10.957893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:45:10.959134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:45:10.960098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 606/1195] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:45:10.965772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41baa78-7a99-45d3-90f9-92c69c7b2ba3 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:11.051691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:11.097874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41baa78-7a99-45d3-90f9-92c69c7b2ba3 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:11.134716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed515224-b781-48bc-8b4b-7c526062a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:11.135384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515224-b781-48bc-8b4b-7c526062a422 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:11.135731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515224-b781-48bc-8b4b-7c526062a422 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:11.136018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515224-b781-48bc-8b4b-7c526062a422 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:11.136771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed515224-b781-48bc-8b4b-7c526062a422 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:45:11.137077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed515224-b781-48bc-8b4b-7c526062a422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:11.138731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed515224-b781-48bc-8b4b-7c526062a422 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:11.148018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 590/1196] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:11.154018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd25f-0054-4728-b659-bd5fd9a3283b None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:11.260642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd25f-0054-4728-b659-bd5fd9a3283b None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:11.295135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43a212-dd14-4565-96c2-d3e34b284b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:11.296165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43a212-dd14-4565-96c2-d3e34b284b98 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:11.296451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43a212-dd14-4565-96c2-d3e34b284b98 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:11.296727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43a212-dd14-4565-96c2-d3e34b284b98 None admin] PATH_INFO: `/v3/users/fc872e8fccee46fcbab24d2ba78a65cc` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:11.297947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43a212-dd14-4565-96c2-d3e34b284b98 None admin] RBAC: Authorizing `identity:get_user(user_id=fc872e8fccee46fcbab24d2ba78a65cc)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:11.299410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43a212-dd14-4565-96c2-d3e34b284b98 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:11.301251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 607/1197] 10.222.0.93 () {56 vars in 1177 bytes} [Thu May 26 16:45:11 2022] GET /identity/v3/users/fc872e8fccee46fcbab24d2ba78a65cc => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:11.308931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed515224-b781-48bc-8b4b-7c526062a422 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:11.467972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed515224-b781-48bc-8b4b-7c526062a422 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:11.510566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:11.524580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523e8e9-8a91-4b1b-8eda-e54e77b4d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:11.524580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523e8e9-8a91-4b1b-8eda-e54e77b4d6a9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:11.524580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523e8e9-8a91-4b1b-8eda-e54e77b4d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:11.525057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523e8e9-8a91-4b1b-8eda-e54e77b4d6a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:11.611001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523e8e9-8a91-4b1b-8eda-e54e77b4d6a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:11.612502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523e8e9-8a91-4b1b-8eda-e54e77b4d6a9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:11.712779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 591/1198] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:45:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:45:11.719078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43a212-dd14-4565-96c2-d3e34b284b98 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:11.730722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:11.822763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43a212-dd14-4565-96c2-d3e34b284b98 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:11.857476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d2d36-5971-4ed5-8eeb-f7859e5a4e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:11.858332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d2d36-5971-4ed5-8eeb-f7859e5a4e59 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:11.858603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d2d36-5971-4ed5-8eeb-f7859e5a4e59 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:11.858868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d2d36-5971-4ed5-8eeb-f7859e5a4e59 None admin] PATH_INFO: `/v3/projects/71685e4510964197a020d83cec48c8b0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:11.860203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d2d36-5971-4ed5-8eeb-f7859e5a4e59 None admin] RBAC: Authorizing `identity:get_project(project_id=71685e4510964197a020d83cec48c8b0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:11.861634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d2d36-5971-4ed5-8eeb-f7859e5a4e59 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:11.863343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 608/1199] 10.222.0.93 () {56 vars in 1186 bytes} [Thu May 26 16:45:11 2022] GET /identity/v3/projects/71685e4510964197a020d83cec48c8b0 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:11.869609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523e8e9-8a91-4b1b-8eda-e54e77b4d6a9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:11.898965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:11.973466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523e8e9-8a91-4b1b-8eda-e54e77b4d6a9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:12.009200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fc9bf-b1e7-43c0-9bb2-d1b23b76c46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:12.009857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fc9bf-b1e7-43c0-9bb2-d1b23b76c46e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:12.010140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fc9bf-b1e7-43c0-9bb2-d1b23b76c46e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:12.010498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fc9bf-b1e7-43c0-9bb2-d1b23b76c46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:12.011329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fc9bf-b1e7-43c0-9bb2-d1b23b76c46e None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=71685e4510964197a020d83cec48c8b0, user.id=fc872e8fccee46fcbab24d2ba78a65cc) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:45:12.011677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fc9bf-b1e7-43c0-9bb2-d1b23b76c46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:12.013121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fc9bf-b1e7-43c0-9bb2-d1b23b76c46e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:12.019109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 592/1200] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:45:11 2022] GET /identity/v3/role_assignments?user.id=fc872e8fccee46fcbab24d2ba78a65cc&scope.project.id=71685e4510964197a020d83cec48c8b0&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:45:21.852527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=62 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:22.016374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=54 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:42.781252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87aa71-6649-436f-beac-d85ab491d597 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:42.781826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87aa71-6649-436f-beac-d85ab491d597 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:42.781826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87aa71-6649-436f-beac-d85ab491d597 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:42.783186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 609/1201] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:42.788636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36f39-cb09-40fb-9143-899295cda324 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:42.789056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36f39-cb09-40fb-9143-899295cda324 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:42.789182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36f39-cb09-40fb-9143-899295cda324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:42.807389 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-94e36f39-cb09-40fb-9143-899295cda324 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:42.808318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-94e36f39-cb09-40fb-9143-899295cda324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:42.880594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 593/1202] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:46:42.906474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87aa71-6649-436f-beac-d85ab491d597 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:43.018884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87aa71-6649-436f-beac-d85ab491d597 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:43.052699 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3e9a-f2c8-42ba-848a-31ba04504d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:43.053480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3e9a-f2c8-42ba-848a-31ba04504d79 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:43.053765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3e9a-f2c8-42ba-848a-31ba04504d79 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:43.054038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3e9a-f2c8-42ba-848a-31ba04504d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:43.064582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe3e9a-f2c8-42ba-848a-31ba04504d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:43.066064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe3e9a-f2c8-42ba-848a-31ba04504d79 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-a3fe3e9a-f2c8-42ba-848a-31ba04504d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:46:43.088495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:43.089749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:43.090735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:46:43.090735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:46:43.090735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:43.090735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:46:43.090735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 610/1203] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:43.096687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36f39-cb09-40fb-9143-899295cda324 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:43.197858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36f39-cb09-40fb-9143-899295cda324 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:43.230448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:43.236488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da580057-03c1-441d-bb1d-d7a12c2c24c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:43.237139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da580057-03c1-441d-bb1d-d7a12c2c24c3 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:43.237415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da580057-03c1-441d-bb1d-d7a12c2c24c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:43.237683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da580057-03c1-441d-bb1d-d7a12c2c24c3 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:43.238400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da580057-03c1-441d-bb1d-d7a12c2c24c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:43.238699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da580057-03c1-441d-bb1d-d7a12c2c24c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:43.240102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da580057-03c1-441d-bb1d-d7a12c2c24c3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:43.251716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 594/1204] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:43.257799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3e9a-f2c8-42ba-848a-31ba04504d79 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:43.310710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:43.359264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3e9a-f2c8-42ba-848a-31ba04504d79 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:43.392550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d820d-c90f-4ba3-9c31-147626246d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:43.393224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d820d-c90f-4ba3-9c31-147626246d29 None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:43.398397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d820d-c90f-4ba3-9c31-147626246d29 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:43.398397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d820d-c90f-4ba3-9c31-147626246d29 None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:43.398397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d820d-c90f-4ba3-9c31-147626246d29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:43.398397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d820d-c90f-4ba3-9c31-147626246d29 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:43.599957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 611/1205] 10.222.0.93 () {60 vars in 1132 bytes} [Thu May 26 16:46:43 2022] POST /identity/v3/users => generated 251 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:46:45.913408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e817-2cec-4969-a692-30c4b8853059 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:45.913961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e817-2cec-4969-a692-30c4b8853059 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:45.913961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e817-2cec-4969-a692-30c4b8853059 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:45.915350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 595/1206] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:46:45.920711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0ef24-c4f1-4044-8fb2-3bbce282e72e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:45.921113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0ef24-c4f1-4044-8fb2-3bbce282e72e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:45.921267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0ef24-c4f1-4044-8fb2-3bbce282e72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:45.938034 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-ade0ef24-c4f1-4044-8fb2-3bbce282e72e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:45.940468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ade0ef24-c4f1-4044-8fb2-3bbce282e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:46.010107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 612/1207] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:46:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:46:46.033690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0e817-2cec-4969-a692-30c4b8853059 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:46.139537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0e817-2cec-4969-a692-30c4b8853059 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:46.174437 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd933653-9ec3-465f-81c9-0898e80fe07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:46.175232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd933653-9ec3-465f-81c9-0898e80fe07e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:46.175512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd933653-9ec3-465f-81c9-0898e80fe07e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:46.175812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd933653-9ec3-465f-81c9-0898e80fe07e None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:46.187469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd933653-9ec3-465f-81c9-0898e80fe07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-dd933653-9ec3-465f-81c9-0898e80fe07e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:46:46.195207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:46.196961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:46.197893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 596/1208] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:46:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:46.203139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0ef24-c4f1-4044-8fb2-3bbce282e72e None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:46.242534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:46.301711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0ef24-c4f1-4044-8fb2-3bbce282e72e None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:46.336376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5de8-b0b5-4ceb-a531-32589a1f50b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:46.337126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5de8-b0b5-4ceb-a531-32589a1f50b0 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:46.337464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5de8-b0b5-4ceb-a531-32589a1f50b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:46.337742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5de8-b0b5-4ceb-a531-32589a1f50b0 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:46.338480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b5de8-b0b5-4ceb-a531-32589a1f50b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:46.338784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b5de8-b0b5-4ceb-a531-32589a1f50b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:46.340193 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b5de8-b0b5-4ceb-a531-32589a1f50b0 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:46.348194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 613/1209] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:46:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:46.354712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd933653-9ec3-465f-81c9-0898e80fe07e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:46.405108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:46.454554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd933653-9ec3-465f-81c9-0898e80fe07e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:46.487473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b423f2-e559-4bac-b23c-8423539ea56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:46.488291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b423f2-e559-4bac-b23c-8423539ea56d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:46.488578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b423f2-e559-4bac-b23c-8423539ea56d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:46.488883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b423f2-e559-4bac-b23c-8423539ea56d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:46.500392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b423f2-e559-4bac-b23c-8423539ea56d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:46.501854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b423f2-e559-4bac-b23c-8423539ea56d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-37b423f2-e559-4bac-b23c-8423539ea56d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:46:46.518348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:46.519395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:46.520408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:46:46.520408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:46:46.520408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:46.520408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:46.520408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 597/1210] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:46.525837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5de8-b0b5-4ceb-a531-32589a1f50b0 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:46.626842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5de8-b0b5-4ceb-a531-32589a1f50b0 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:46.647344 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:46.661603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470c739-54c8-4f43-8855-e374e5bdf111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:46.662376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470c739-54c8-4f43-8855-e374e5bdf111 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:46.662651 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470c739-54c8-4f43-8855-e374e5bdf111 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:46.662921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470c739-54c8-4f43-8855-e374e5bdf111 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:46.663653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470c739-54c8-4f43-8855-e374e5bdf111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:46.663956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470c739-54c8-4f43-8855-e374e5bdf111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:46.665866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470c739-54c8-4f43-8855-e374e5bdf111 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:46.677715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 614/1211] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:46:46.684071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b423f2-e559-4bac-b23c-8423539ea56d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:46.796561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b423f2-e559-4bac-b23c-8423539ea56d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:46.798154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:46.829841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579264-3c2d-4150-af62-709ebafbc025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:46.830646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579264-3c2d-4150-af62-709ebafbc025 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:46.830930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579264-3c2d-4150-af62-709ebafbc025 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:46.831204 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579264-3c2d-4150-af62-709ebafbc025 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:46.838619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579264-3c2d-4150-af62-709ebafbc025 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:46.840092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579264-3c2d-4150-af62-709ebafbc025 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-6e579264-3c2d-4150-af62-709ebafbc025 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:46:46.855171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:46.862057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:46.863295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 598/1212] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:46.864214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470c739-54c8-4f43-8855-e374e5bdf111 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:46.962763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470c739-54c8-4f43-8855-e374e5bdf111 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:46.997229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03ce7c-14e9-406b-9a1e-5e4342d9941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:46.997892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03ce7c-14e9-406b-9a1e-5e4342d9941e None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:46.998173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03ce7c-14e9-406b-9a1e-5e4342d9941e None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:46.998451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03ce7c-14e9-406b-9a1e-5e4342d9941e None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:46.999277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03ce7c-14e9-406b-9a1e-5e4342d9941e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:46.999603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03ce7c-14e9-406b-9a1e-5e4342d9941e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:47.001025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03ce7c-14e9-406b-9a1e-5e4342d9941e None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:47.018201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 615/1213] 10.222.0.93 () {56 vars in 1143 bytes} [Thu May 26 16:46:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:47.024533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579264-3c2d-4150-af62-709ebafbc025 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:47.125607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579264-3c2d-4150-af62-709ebafbc025 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:47.160545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8548b-70e5-403e-8442-ef6bdacc57ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:47.161181 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8548b-70e5-403e-8442-ef6bdacc57ec None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:47.161466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8548b-70e5-403e-8442-ef6bdacc57ec None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:47.161744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8548b-70e5-403e-8442-ef6bdacc57ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:47.190996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:47.228643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8548b-70e5-403e-8442-ef6bdacc57ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:47.230251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8548b-70e5-403e-8442-ef6bdacc57ec None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:47.327067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 599/1214] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:46:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:46:47.333114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03ce7c-14e9-406b-9a1e-5e4342d9941e None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:47.354073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:47.438602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03ce7c-14e9-406b-9a1e-5e4342d9941e None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:47.473384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacda4d2-fe55-42c7-a6b4-bc926f472c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:47.474193 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacda4d2-fe55-42c7-a6b4-bc926f472c81 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:47.474473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacda4d2-fe55-42c7-a6b4-bc926f472c81 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:47.474752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacda4d2-fe55-42c7-a6b4-bc926f472c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:47.484773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacda4d2-fe55-42c7-a6b4-bc926f472c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:47.486210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacda4d2-fe55-42c7-a6b4-bc926f472c81 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-aacda4d2-fe55-42c7-a6b4-bc926f472c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:46:47.503951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:47.505127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:47.506074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:46:47.506074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:46:47.506074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:47.506074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:46:47.506074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 616/1215] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:47.511808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8548b-70e5-403e-8442-ef6bdacc57ec None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:47.571548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:47.609612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8548b-70e5-403e-8442-ef6bdacc57ec None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:47.643254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f70345-705a-4412-a703-22614899524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:47.643947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f70345-705a-4412-a703-22614899524f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:47.644230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f70345-705a-4412-a703-22614899524f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:47.644504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f70345-705a-4412-a703-22614899524f None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:47.645219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f70345-705a-4412-a703-22614899524f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:47.645521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f70345-705a-4412-a703-22614899524f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:47.646899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f70345-705a-4412-a703-22614899524f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:47.659865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 600/1216] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:47.665550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacda4d2-fe55-42c7-a6b4-bc926f472c81 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:47.736536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:47.767884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacda4d2-fe55-42c7-a6b4-bc926f472c81 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:47.801575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1cc8-ec77-4bfc-8edf-371d5f8ae652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:47.802372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1cc8-ec77-4bfc-8edf-371d5f8ae652 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:47.802654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1cc8-ec77-4bfc-8edf-371d5f8ae652 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:47.802928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1cc8-ec77-4bfc-8edf-371d5f8ae652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:47.810219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa1cc8-ec77-4bfc-8edf-371d5f8ae652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:47.813183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa1cc8-ec77-4bfc-8edf-371d5f8ae652 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-daaa1cc8-ec77-4bfc-8edf-371d5f8ae652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:46:47.826049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:47.827126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:47.828299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:46:47.828299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:46:47.828299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:46:47.828299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:46:47.828299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:46:47.828299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:46:47.828299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:46:47.828299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:46:47.828299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 617/1217] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:47.833449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f70345-705a-4412-a703-22614899524f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:47.935998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f70345-705a-4412-a703-22614899524f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:47.962516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:47.970873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fba408-a2e0-4f4e-8b2c-eafc8a9cb59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:47.971530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba408-a2e0-4f4e-8b2c-eafc8a9cb59c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:47.971840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba408-a2e0-4f4e-8b2c-eafc8a9cb59c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:47.972117 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba408-a2e0-4f4e-8b2c-eafc8a9cb59c None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:47.972895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba408-a2e0-4f4e-8b2c-eafc8a9cb59c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:47.973204 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba408-a2e0-4f4e-8b2c-eafc8a9cb59c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:47.974632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba408-a2e0-4f4e-8b2c-eafc8a9cb59c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:47.986619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 601/1218] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:47.993393 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1cc8-ec77-4bfc-8edf-371d5f8ae652 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:48.092132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1cc8-ec77-4bfc-8edf-371d5f8ae652 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:48.121224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:48.128060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d57be-ec41-42f2-9be1-72e220566bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:48.128718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d57be-ec41-42f2-9be1-72e220566bb5 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:48.129000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d57be-ec41-42f2-9be1-72e220566bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:48.129270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d57be-ec41-42f2-9be1-72e220566bb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:48.130082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d57be-ec41-42f2-9be1-72e220566bb5 None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=bae184afff284dcaa228859902e92191) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:48.130384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d57be-ec41-42f2-9be1-72e220566bb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:48.131855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d57be-ec41-42f2-9be1-72e220566bb5 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:48.137349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 618/1219] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:46:47 2022] GET /identity/v3/role_assignments?user.id=bae184afff284dcaa228859902e92191&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:50.342530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb5b4-58c4-4697-bacf-0e6ea2094e8a None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:50.343131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb5b4-58c4-4697-bacf-0e6ea2094e8a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:50.343131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb5b4-58c4-4697-bacf-0e6ea2094e8a None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:50.344831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 602/1220] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:50.350183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b48b13-544a-4ea0-9912-0135b554c48d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:50.359278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b48b13-544a-4ea0-9912-0135b554c48d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:50.359278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b48b13-544a-4ea0-9912-0135b554c48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:50.368327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-62b48b13-544a-4ea0-9912-0135b554c48d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:50.369520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-62b48b13-544a-4ea0-9912-0135b554c48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:50.435924 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 619/1221] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:46:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:46:50.463978 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacb5b4-58c4-4697-bacf-0e6ea2094e8a None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:50.566697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacb5b4-58c4-4697-bacf-0e6ea2094e8a None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:50.601921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd91e28-1725-4c79-9f74-e116c397bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:50.602665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd91e28-1725-4c79-9f74-e116c397bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:50.602947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd91e28-1725-4c79-9f74-e116c397bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:50.603219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd91e28-1725-4c79-9f74-e116c397bfd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:50.613400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd91e28-1725-4c79-9f74-e116c397bfd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-abd91e28-1725-4c79-9f74-e116c397bfd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:46:50.621901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:50.623094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:50.624174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 603/1222] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:46:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:50.629750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b48b13-544a-4ea0-9912-0135b554c48d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:50.731054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b48b13-544a-4ea0-9912-0135b554c48d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:50.760634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:50.771874 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b4cf2-f9dd-4a8c-8ca8-229174834520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:50.772469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b4cf2-f9dd-4a8c-8ca8-229174834520 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:50.772750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b4cf2-f9dd-4a8c-8ca8-229174834520 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:50.773023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b4cf2-f9dd-4a8c-8ca8-229174834520 None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:50.773755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b4cf2-f9dd-4a8c-8ca8-229174834520 None admin] RBAC: Adding query filter params (name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:50.774086 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b4cf2-f9dd-4a8c-8ca8-229174834520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:50.775580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b4cf2-f9dd-4a8c-8ca8-229174834520 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:50.783707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 620/1223] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:46:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:50.789650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd91e28-1725-4c79-9f74-e116c397bfd4 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:50.835367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:50.892620 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd91e28-1725-4c79-9f74-e116c397bfd4 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:50.926420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e6b47-4df4-4649-b5b6-e1c839eef583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:50.927209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e6b47-4df4-4649-b5b6-e1c839eef583 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:50.927489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e6b47-4df4-4649-b5b6-e1c839eef583 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:50.927788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e6b47-4df4-4649-b5b6-e1c839eef583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:50.939122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e6b47-4df4-4649-b5b6-e1c839eef583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:50.940610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e6b47-4df4-4649-b5b6-e1c839eef583 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-653e6b47-4df4-4649-b5b6-e1c839eef583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:46:50.957342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:50.958280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:50.959230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:46:50.959230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:46:50.959230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:50.959230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:50.959230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 604/1224] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:46:50.964464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b4cf2-f9dd-4a8c-8ca8-229174834520 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:51.063215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b4cf2-f9dd-4a8c-8ca8-229174834520 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:51.103332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab025a22-26b2-43a2-a4ae-f5f048f9baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:51.104240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab025a22-26b2-43a2-a4ae-f5f048f9baea None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:51.104525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab025a22-26b2-43a2-a4ae-f5f048f9baea None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:51.104795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab025a22-26b2-43a2-a4ae-f5f048f9baea None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:51.105580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab025a22-26b2-43a2-a4ae-f5f048f9baea None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:51.105878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab025a22-26b2-43a2-a4ae-f5f048f9baea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:51.107415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab025a22-26b2-43a2-a4ae-f5f048f9baea None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:51.121525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 621/1225] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:51.127695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e6b47-4df4-4649-b5b6-e1c839eef583 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:51.226830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:51.234092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e6b47-4df4-4649-b5b6-e1c839eef583 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:51.267121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26837aa-9750-457a-94ed-96dbac0a4bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:51.267961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26837aa-9750-457a-94ed-96dbac0a4bcc None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:51.268242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26837aa-9750-457a-94ed-96dbac0a4bcc None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:51.268517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26837aa-9750-457a-94ed-96dbac0a4bcc None admin] PATH_INFO: `/v3/users/placement` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:51.276399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26837aa-9750-457a-94ed-96dbac0a4bcc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:51.283852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26837aa-9750-457a-94ed-96dbac0a4bcc None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-e26837aa-9750-457a-94ed-96dbac0a4bcc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:46:51.293026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:51.294163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:51.295394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 605/1226] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:51.300181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab025a22-26b2-43a2-a4ae-f5f048f9baea None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:51.353135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:51.407551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab025a22-26b2-43a2-a4ae-f5f048f9baea None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:51.444188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e15b8-fadb-4019-b13b-537a30e8840a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:51.444962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e15b8-fadb-4019-b13b-537a30e8840a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:51.445245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e15b8-fadb-4019-b13b-537a30e8840a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:51.445521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e15b8-fadb-4019-b13b-537a30e8840a None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:51.446368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e15b8-fadb-4019-b13b-537a30e8840a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:51.446676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e15b8-fadb-4019-b13b-537a30e8840a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:51.448254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e15b8-fadb-4019-b13b-537a30e8840a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:51.468075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 622/1227] 10.222.0.93 () {56 vars in 1143 bytes} [Thu May 26 16:46:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:51.474447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26837aa-9750-457a-94ed-96dbac0a4bcc None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:51.575425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26837aa-9750-457a-94ed-96dbac0a4bcc None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:51.611945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e217b-f166-4ad9-9cad-bafed1184e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:51.612728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e217b-f166-4ad9-9cad-bafed1184e11 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:51.613014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e217b-f166-4ad9-9cad-bafed1184e11 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:51.613286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e217b-f166-4ad9-9cad-bafed1184e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:51.623626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e217b-f166-4ad9-9cad-bafed1184e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:51.625198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e217b-f166-4ad9-9cad-bafed1184e11 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9a6e217b-f166-4ad9-9cad-bafed1184e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:46:51.643917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:51.645041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:51.646369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:46:51.646369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:46:51.646369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:51.646369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:51.646369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 606/1228] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:51.651480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e15b8-fadb-4019-b13b-537a30e8840a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:51.755649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e15b8-fadb-4019-b13b-537a30e8840a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:51.758056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:51.790311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cef82-0caa-4781-8fc3-374e10cbc5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:51.790966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cef82-0caa-4781-8fc3-374e10cbc5fe None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:51.791248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cef82-0caa-4781-8fc3-374e10cbc5fe None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:51.791527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cef82-0caa-4781-8fc3-374e10cbc5fe None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:51.792276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cef82-0caa-4781-8fc3-374e10cbc5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:51.792579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cef82-0caa-4781-8fc3-374e10cbc5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:51.793959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cef82-0caa-4781-8fc3-374e10cbc5fe None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:51.806753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 623/1229] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:51.812729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e217b-f166-4ad9-9cad-bafed1184e11 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:51.822274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:51.911989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e217b-f166-4ad9-9cad-bafed1184e11 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:51.944166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb4133-d527-4f46-8747-d33c79dd6984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:51.944945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb4133-d527-4f46-8747-d33c79dd6984 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:51.945231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb4133-d527-4f46-8747-d33c79dd6984 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:51.945507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb4133-d527-4f46-8747-d33c79dd6984 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:51.952739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb4133-d527-4f46-8747-d33c79dd6984 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:51.954197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb4133-d527-4f46-8747-d33c79dd6984 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-74bb4133-d527-4f46-8747-d33c79dd6984 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:46:51.969412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:51.975142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:51.976438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:46:51.976438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:46:51.976438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:46:51.976438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:46:51.976438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:46:51.976438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:46:51.976438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:46:51.976438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:51.976438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 607/1230] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:51.977042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cef82-0caa-4781-8fc3-374e10cbc5fe None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:52.078743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cef82-0caa-4781-8fc3-374e10cbc5fe None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:52.112210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2a8e5-c659-4189-a05f-d2781f13aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:52.112865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a8e5-c659-4189-a05f-d2781f13aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:52.113144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a8e5-c659-4189-a05f-d2781f13aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:52.113414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a8e5-c659-4189-a05f-d2781f13aaf7 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:52.114187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2a8e5-c659-4189-a05f-d2781f13aaf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:52.123583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2a8e5-c659-4189-a05f-d2781f13aaf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:52.123583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2a8e5-c659-4189-a05f-d2781f13aaf7 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:52.128632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 624/1231] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:52.135449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb4133-d527-4f46-8747-d33c79dd6984 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:52.206263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:52.240360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb4133-d527-4f46-8747-d33c79dd6984 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:52.292035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14583-0e1e-4eb1-a0c7-27ab34dbdd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:52.293489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14583-0e1e-4eb1-a0c7-27ab34dbdd12 None admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:52.293963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14583-0e1e-4eb1-a0c7-27ab34dbdd12 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:52.294435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14583-0e1e-4eb1-a0c7-27ab34dbdd12 None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/bae184afff284dcaa228859902e92191/roles/a13a3c6af2864ff1848ccbb2da56273e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:52.319132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14583-0e1e-4eb1-a0c7-27ab34dbdd12 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=bae184afff284dcaa228859902e92191, role_id=a13a3c6af2864ff1848ccbb2da56273e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:52.322411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14583-0e1e-4eb1-a0c7-27ab34dbdd12 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:52.490842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 608/1232] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:46:52 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/bae184afff284dcaa228859902e92191/roles/a13a3c6af2864ff1848ccbb2da56273e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:46:54.758701 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab949fe-3e12-478c-92be-7e82ceea3e01 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:54.759225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab949fe-3e12-478c-92be-7e82ceea3e01 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:54.759321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab949fe-3e12-478c-92be-7e82ceea3e01 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:54.760666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 625/1233] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:46:54.765948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49a63-8450-4fae-ab21-07fd85f9b790 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:54.766493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49a63-8450-4fae-ab21-07fd85f9b790 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:54.766493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49a63-8450-4fae-ab21-07fd85f9b790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:54.783919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d9e49a63-8450-4fae-ab21-07fd85f9b790 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:54.785134 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d9e49a63-8450-4fae-ab21-07fd85f9b790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:54.853110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 609/1234] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:46:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:46:54.877045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab949fe-3e12-478c-92be-7e82ceea3e01 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:54.907054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:54.989667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab949fe-3e12-478c-92be-7e82ceea3e01 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:55.024085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bae60-e947-49bb-9fef-d091a65048ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:55.024870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bae60-e947-49bb-9fef-d091a65048ba None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:55.025152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bae60-e947-49bb-9fef-d091a65048ba None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:55.025424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bae60-e947-49bb-9fef-d091a65048ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:55.035201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bae60-e947-49bb-9fef-d091a65048ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-2a7bae60-e947-49bb-9fef-d091a65048ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:46:55.043271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:55.044471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:46:55.045506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 626/1235] 10.222.0.93 () {56 vars in 1102 bytes} [Thu May 26 16:46:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:55.050581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49a63-8450-4fae-ab21-07fd85f9b790 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:55.104891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:55.160330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49a63-8450-4fae-ab21-07fd85f9b790 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:55.193902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76b1bd-5b04-445b-8bd9-5346dd9d70d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:55.194567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76b1bd-5b04-445b-8bd9-5346dd9d70d9 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:55.194850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76b1bd-5b04-445b-8bd9-5346dd9d70d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:55.195125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76b1bd-5b04-445b-8bd9-5346dd9d70d9 None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:55.196513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76b1bd-5b04-445b-8bd9-5346dd9d70d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:55.196818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76b1bd-5b04-445b-8bd9-5346dd9d70d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:55.198267 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76b1bd-5b04-445b-8bd9-5346dd9d70d9 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:55.206586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 610/1236] 10.222.0.93 () {56 vars in 1103 bytes} [Thu May 26 16:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:55.212408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bae60-e947-49bb-9fef-d091a65048ba None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:55.296237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:55.311979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bae60-e947-49bb-9fef-d091a65048ba None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:55.345974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb4c8-1f88-4350-9f00-e4fad878a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:55.346754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb4c8-1f88-4350-9f00-e4fad878a628 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:55.347037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb4c8-1f88-4350-9f00-e4fad878a628 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:55.347308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb4c8-1f88-4350-9f00-e4fad878a628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:55.359939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb4c8-1f88-4350-9f00-e4fad878a628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:55.361403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb4c8-1f88-4350-9f00-e4fad878a628 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-046bb4c8-1f88-4350-9f00-e4fad878a628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:46:55.382375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:55.383618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:55.384777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:46:55.384777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:46:55.384777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:55.384777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:46:55.384777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 627/1237] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:55.390319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76b1bd-5b04-445b-8bd9-5346dd9d70d9 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:55.494635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76b1bd-5b04-445b-8bd9-5346dd9d70d9 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:55.503833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:55.528008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfaed9-2e31-430f-893e-094d28105431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:55.528694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfaed9-2e31-430f-893e-094d28105431 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:55.528961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfaed9-2e31-430f-893e-094d28105431 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:55.529232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfaed9-2e31-430f-893e-094d28105431 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:55.529949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfaed9-2e31-430f-893e-094d28105431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:55.530252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfaed9-2e31-430f-893e-094d28105431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:55.531640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfaed9-2e31-430f-893e-094d28105431 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:55.544080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 611/1238] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:55.549947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb4c8-1f88-4350-9f00-e4fad878a628 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:55.652871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb4c8-1f88-4350-9f00-e4fad878a628 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:55.690471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7e951-51d0-4828-aaa3-bf5edce918d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:55.691290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7e951-51d0-4828-aaa3-bf5edce918d9 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:55.691617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7e951-51d0-4828-aaa3-bf5edce918d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:55.691881 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7e951-51d0-4828-aaa3-bf5edce918d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:55.694679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:55.704836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7e951-51d0-4828-aaa3-bf5edce918d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:55.706306 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7e951-51d0-4828-aaa3-bf5edce918d9 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-82b7e951-51d0-4828-aaa3-bf5edce918d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:46:55.721645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:55.728731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:46:55.730100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 628/1239] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:55.730851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfaed9-2e31-430f-893e-094d28105431 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:55.830270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfaed9-2e31-430f-893e-094d28105431 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:55.865841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef84c6-d6ae-4953-bf15-7a4be1b5ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:55.866542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef84c6-d6ae-4953-bf15-7a4be1b5ead6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:55.866828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef84c6-d6ae-4953-bf15-7a4be1b5ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:55.867104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef84c6-d6ae-4953-bf15-7a4be1b5ead6 None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:55.868024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef84c6-d6ae-4953-bf15-7a4be1b5ead6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:55.868335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef84c6-d6ae-4953-bf15-7a4be1b5ead6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:55.869766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef84c6-d6ae-4953-bf15-7a4be1b5ead6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:55.887735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 612/1240] 10.222.0.93 () {56 vars in 1143 bytes} [Thu May 26 16:46:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:55.896291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7e951-51d0-4828-aaa3-bf5edce918d9 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:56.012795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7e951-51d0-4828-aaa3-bf5edce918d9 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:56.047445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8969aa-b9b2-4395-87c6-93859abbacca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:56.048115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8969aa-b9b2-4395-87c6-93859abbacca None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:56.048394 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8969aa-b9b2-4395-87c6-93859abbacca None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:56.048689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8969aa-b9b2-4395-87c6-93859abbacca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:56.110127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:56.116446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8969aa-b9b2-4395-87c6-93859abbacca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:56.118065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8969aa-b9b2-4395-87c6-93859abbacca None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:56.213533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 629/1241] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:46:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:46:56.220005 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef84c6-d6ae-4953-bf15-7a4be1b5ead6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:56.246761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:56.319676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef84c6-d6ae-4953-bf15-7a4be1b5ead6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:56.355091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291b4be-426e-45f9-ae37-8225503062ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:56.355890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291b4be-426e-45f9-ae37-8225503062ba None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:56.356186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291b4be-426e-45f9-ae37-8225503062ba None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:56.356465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291b4be-426e-45f9-ae37-8225503062ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:56.369327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291b4be-426e-45f9-ae37-8225503062ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:56.370861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291b4be-426e-45f9-ae37-8225503062ba None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-4291b4be-426e-45f9-ae37-8225503062ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:46:56.388945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:56.390174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:56.391319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:46:56.391319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:46:56.391319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:46:56.391319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:56.391319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 613/1242] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:56.396159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8969aa-b9b2-4395-87c6-93859abbacca None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:56.489805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:56.496220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8969aa-b9b2-4395-87c6-93859abbacca None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:56.529781 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83898a2-8ddf-4cff-9ada-6a42a66ec6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:56.530432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83898a2-8ddf-4cff-9ada-6a42a66ec6b6 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:56.530710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83898a2-8ddf-4cff-9ada-6a42a66ec6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:56.530980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83898a2-8ddf-4cff-9ada-6a42a66ec6b6 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:56.531724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83898a2-8ddf-4cff-9ada-6a42a66ec6b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:56.532026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83898a2-8ddf-4cff-9ada-6a42a66ec6b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:56.533379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83898a2-8ddf-4cff-9ada-6a42a66ec6b6 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:56.545449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 630/1243] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:56.551489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291b4be-426e-45f9-ae37-8225503062ba None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:56.643159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:56.664908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291b4be-426e-45f9-ae37-8225503062ba None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:56.706072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391acfb-1355-48d4-9470-94d2af260f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:56.706828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391acfb-1355-48d4-9470-94d2af260f45 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:56.707112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391acfb-1355-48d4-9470-94d2af260f45 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:56.707382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391acfb-1355-48d4-9470-94d2af260f45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:56.714751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391acfb-1355-48d4-9470-94d2af260f45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:56.717103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391acfb-1355-48d4-9470-94d2af260f45 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-4391acfb-1355-48d4-9470-94d2af260f45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:46:56.731682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:56.733449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:56.734572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:46:56.734572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:46:56.734572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:46:56.734572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:46:56.734572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:46:56.734572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:46:56.734572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:46:56.734572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:46:56.734572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 614/1244] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:56.738795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83898a2-8ddf-4cff-9ada-6a42a66ec6b6 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:56.845416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83898a2-8ddf-4cff-9ada-6a42a66ec6b6 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:56.889244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1e24f-d4ef-4909-a611-a136dd7dd5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:56.889906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1e24f-d4ef-4909-a611-a136dd7dd5e2 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:56.890245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1e24f-d4ef-4909-a611-a136dd7dd5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:56.890526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1e24f-d4ef-4909-a611-a136dd7dd5e2 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:56.891316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1e24f-d4ef-4909-a611-a136dd7dd5e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:56.891648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1e24f-d4ef-4909-a611-a136dd7dd5e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:56.893084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1e24f-d4ef-4909-a611-a136dd7dd5e2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:56.908982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 631/1245] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:56.915887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391acfb-1355-48d4-9470-94d2af260f45 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:57.020873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391acfb-1355-48d4-9470-94d2af260f45 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:57.055991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a052037-340f-4863-a4ce-89870af79105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:57.056836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a052037-340f-4863-a4ce-89870af79105 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:57.057124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a052037-340f-4863-a4ce-89870af79105 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:57.057402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a052037-340f-4863-a4ce-89870af79105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:57.058229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a052037-340f-4863-a4ce-89870af79105 None admin] RBAC: Adding query filter params (role.id=a13a3c6af2864ff1848ccbb2da56273e, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=bae184afff284dcaa228859902e92191) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:57.058545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a052037-340f-4863-a4ce-89870af79105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:57.060013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a052037-340f-4863-a4ce-89870af79105 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:57.066415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 615/1246] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:46:56 2022] GET /identity/v3/role_assignments?user.id=bae184afff284dcaa228859902e92191&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=a13a3c6af2864ff1848ccbb2da56273e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:59.382164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9e12a-4a37-4a13-97a5-ae78a4b79fb5 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:59.382735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9e12a-4a37-4a13-97a5-ae78a4b79fb5 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:59.382735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9e12a-4a37-4a13-97a5-ae78a4b79fb5 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:59.384641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 632/1247] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:59.390230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3b5a1-5ab9-4c0f-bdb5-04059ca20d9c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:59.390837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3b5a1-5ab9-4c0f-bdb5-04059ca20d9c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:59.390837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3b5a1-5ab9-4c0f-bdb5-04059ca20d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:59.395934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:59.410587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-13e3b5a1-5ab9-4c0f-bdb5-04059ca20d9c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:59.411818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-13e3b5a1-5ab9-4c0f-bdb5-04059ca20d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:59.481632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 616/1248] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:46:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:46:59.506331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9e12a-4a37-4a13-97a5-ae78a4b79fb5 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:59.527763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:59.614472 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9e12a-4a37-4a13-97a5-ae78a4b79fb5 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:59.652961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa2f75-aa58-4058-81e7-c30099e42ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:59.653668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa2f75-aa58-4058-81e7-c30099e42ec2 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:59.653951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa2f75-aa58-4058-81e7-c30099e42ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:59.654226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa2f75-aa58-4058-81e7-c30099e42ec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:59.665543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa2f75-aa58-4058-81e7-c30099e42ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-1cfa2f75-aa58-4058-81e7-c30099e42ec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:46:59.673308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:46:59.674378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:46:59.675268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 633/1249] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:46:59.681805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3b5a1-5ab9-4c0f-bdb5-04059ca20d9c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:59.822654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3b5a1-5ab9-4c0f-bdb5-04059ca20d9c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:59.853698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:59.858811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e54dcd-50cb-4662-a01e-abe3e785bc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:59.859486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e54dcd-50cb-4662-a01e-abe3e785bc2c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:59.859799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e54dcd-50cb-4662-a01e-abe3e785bc2c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:59.860075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e54dcd-50cb-4662-a01e-abe3e785bc2c None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:59.860832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e54dcd-50cb-4662-a01e-abe3e785bc2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:46:59.861136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e54dcd-50cb-4662-a01e-abe3e785bc2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:59.862522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e54dcd-50cb-4662-a01e-abe3e785bc2c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:59.872033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 617/1250] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:46:59.878066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa2f75-aa58-4058-81e7-c30099e42ec2 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:59.957126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:59.983905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa2f75-aa58-4058-81e7-c30099e42ec2 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:00.020477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52b8fd-03e0-4a66-8054-237088869cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:00.021274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52b8fd-03e0-4a66-8054-237088869cc3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.021547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52b8fd-03e0-4a66-8054-237088869cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.021817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52b8fd-03e0-4a66-8054-237088869cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.033076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52b8fd-03e0-4a66-8054-237088869cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:00.034522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52b8fd-03e0-4a66-8054-237088869cc3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-1e52b8fd-03e0-4a66-8054-237088869cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:47:00.051770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:00.055080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:00.056229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:47:00.056229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:47:00.056229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:00.056229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:47:00.056229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 634/1251] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:00.060400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e54dcd-50cb-4662-a01e-abe3e785bc2c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:00.167412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e54dcd-50cb-4662-a01e-abe3e785bc2c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:00.203450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247bb51-a850-4439-986f-79bb156dad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:00.204287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247bb51-a850-4439-986f-79bb156dad2c None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.204621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247bb51-a850-4439-986f-79bb156dad2c None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.204946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247bb51-a850-4439-986f-79bb156dad2c None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.205747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247bb51-a850-4439-986f-79bb156dad2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:00.206103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247bb51-a850-4439-986f-79bb156dad2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:00.207699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247bb51-a850-4439-986f-79bb156dad2c None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:00.222486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 618/1252] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:00.228936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52b8fd-03e0-4a66-8054-237088869cc3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:00.348287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52b8fd-03e0-4a66-8054-237088869cc3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:00.378680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:00.386459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b8300-1723-4a85-b54c-1f5140420f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:00.387328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b8300-1723-4a85-b54c-1f5140420f4a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.387614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b8300-1723-4a85-b54c-1f5140420f4a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.387923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b8300-1723-4a85-b54c-1f5140420f4a None admin] PATH_INFO: `/v3/users/placement` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.395905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b8300-1723-4a85-b54c-1f5140420f4a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:00.397362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b8300-1723-4a85-b54c-1f5140420f4a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-5b5b8300-1723-4a85-b54c-1f5140420f4a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:47:00.412547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:00.415234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:47:00.417222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 635/1253] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:47:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:00.420475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247bb51-a850-4439-986f-79bb156dad2c None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:00.487839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:00.535926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247bb51-a850-4439-986f-79bb156dad2c None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:00.572104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c391-a18f-45f2-8648-6315f72cb32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:00.572368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c391-a18f-45f2-8648-6315f72cb32f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.572468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c391-a18f-45f2-8648-6315f72cb32f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.572749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c391-a18f-45f2-8648-6315f72cb32f None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.573592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16c391-a18f-45f2-8648-6315f72cb32f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:00.573904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16c391-a18f-45f2-8648-6315f72cb32f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:00.575349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16c391-a18f-45f2-8648-6315f72cb32f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:00.594956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 619/1254] 10.222.0.93 () {56 vars in 1143 bytes} [Thu May 26 16:47:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:00.600700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b8300-1723-4a85-b54c-1f5140420f4a None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:00.726457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b8300-1723-4a85-b54c-1f5140420f4a None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:00.767130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784286da-455f-468c-92ac-6b92cc086712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:00.767741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784286da-455f-468c-92ac-6b92cc086712 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.768026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784286da-455f-468c-92ac-6b92cc086712 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.768301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784286da-455f-468c-92ac-6b92cc086712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.832282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:00.846251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784286da-455f-468c-92ac-6b92cc086712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:00.847764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784286da-455f-468c-92ac-6b92cc086712 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:00.975714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 636/1255] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:47:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:47:00.982118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c391-a18f-45f2-8648-6315f72cb32f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:01.098713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c391-a18f-45f2-8648-6315f72cb32f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:01.113491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:01.136430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1a62-8f56-4d3b-8396-5b9260d23918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:01.137297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1a62-8f56-4d3b-8396-5b9260d23918 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:01.137585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1a62-8f56-4d3b-8396-5b9260d23918 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:01.137863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1a62-8f56-4d3b-8396-5b9260d23918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:01.148144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a1a62-8f56-4d3b-8396-5b9260d23918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:01.149698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a1a62-8f56-4d3b-8396-5b9260d23918 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-573a1a62-8f56-4d3b-8396-5b9260d23918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:47:01.168040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:01.169131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:01.170070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:47:01.170070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:47:01.170070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:01.170070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:01.170070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 620/1256] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:01.175099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784286da-455f-468c-92ac-6b92cc086712 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:01.272857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:01.286265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784286da-455f-468c-92ac-6b92cc086712 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:01.323554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3d13f-d762-43f0-99e1-a9c582487d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:01.324246 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3d13f-d762-43f0-99e1-a9c582487d2f None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:01.324529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3d13f-d762-43f0-99e1-a9c582487d2f None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:01.324798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3d13f-d762-43f0-99e1-a9c582487d2f None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:01.325532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3d13f-d762-43f0-99e1-a9c582487d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:01.325857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3d13f-d762-43f0-99e1-a9c582487d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:01.327248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3d13f-d762-43f0-99e1-a9c582487d2f None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:01.339630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 637/1257] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:01.345769 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1a62-8f56-4d3b-8396-5b9260d23918 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:01.458982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1a62-8f56-4d3b-8396-5b9260d23918 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:01.497760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c7a88-cdd7-4da4-aec1-28d69e59fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:01.498571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c7a88-cdd7-4da4-aec1-28d69e59fb1f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:01.498859 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c7a88-cdd7-4da4-aec1-28d69e59fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:01.499138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c7a88-cdd7-4da4-aec1-28d69e59fb1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:01.506745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c7a88-cdd7-4da4-aec1-28d69e59fb1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:01.511138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c7a88-cdd7-4da4-aec1-28d69e59fb1f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9c9c7a88-cdd7-4da4-aec1-28d69e59fb1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:47:01.522681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:01.523916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:01.525236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:47:01.525236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:47:01.525236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:47:01.525236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:47:01.525236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:47:01.525236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:47:01.525236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:47:01.525236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:01.525236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 621/1258] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:47:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:01.530156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3d13f-d762-43f0-99e1-a9c582487d2f None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:01.641070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3d13f-d762-43f0-99e1-a9c582487d2f None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:01.675691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0868b-3fef-4ad8-9b73-6f824d4df071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:01.676350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0868b-3fef-4ad8-9b73-6f824d4df071 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:01.676632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0868b-3fef-4ad8-9b73-6f824d4df071 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:01.676905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0868b-3fef-4ad8-9b73-6f824d4df071 None admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:01.677690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0868b-3fef-4ad8-9b73-6f824d4df071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:01.677997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0868b-3fef-4ad8-9b73-6f824d4df071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:01.679416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0868b-3fef-4ad8-9b73-6f824d4df071 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:01.692749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 638/1259] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:47:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:01.699022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c7a88-cdd7-4da4-aec1-28d69e59fb1f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:01.726002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:01.799846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c7a88-cdd7-4da4-aec1-28d69e59fb1f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:01.833444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215eca3-fc7a-44c0-b76a-473312b74899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:01.834086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215eca3-fc7a-44c0-b76a-473312b74899 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:01.834364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215eca3-fc7a-44c0-b76a-473312b74899 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:01.834638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215eca3-fc7a-44c0-b76a-473312b74899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:01.835461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215eca3-fc7a-44c0-b76a-473312b74899 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=bae184afff284dcaa228859902e92191) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:01.835795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215eca3-fc7a-44c0-b76a-473312b74899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:01.837771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215eca3-fc7a-44c0-b76a-473312b74899 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:01.843616 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 622/1260] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:47:01 2022] GET /identity/v3/role_assignments?user.id=bae184afff284dcaa228859902e92191&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:04.237803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df18359-801f-458d-8a0a-d8a3595f65c2 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:04.238352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df18359-801f-458d-8a0a-d8a3595f65c2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:04.238352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df18359-801f-458d-8a0a-d8a3595f65c2 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:04.246453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 639/1261] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:04.246590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e59e7-7927-4be2-8332-2a1976e80074 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:04.246590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e59e7-7927-4be2-8332-2a1976e80074 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:04.247129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e59e7-7927-4be2-8332-2a1976e80074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:04.267312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3e5e59e7-7927-4be2-8332-2a1976e80074 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:04.268539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3e5e59e7-7927-4be2-8332-2a1976e80074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:04.343248 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 623/1262] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:47:04.366899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df18359-801f-458d-8a0a-d8a3595f65c2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:04.378799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:04.477084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df18359-801f-458d-8a0a-d8a3595f65c2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:04.531092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf8bae-1197-4cc1-b546-3060a828b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:04.531846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf8bae-1197-4cc1-b546-3060a828b313 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:04.532127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf8bae-1197-4cc1-b546-3060a828b313 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:04.532399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf8bae-1197-4cc1-b546-3060a828b313 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:04.543946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf8bae-1197-4cc1-b546-3060a828b313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-dbdf8bae-1197-4cc1-b546-3060a828b313 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:47:04.551541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:04.552768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:47:04.553873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 640/1263] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:04.560420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e59e7-7927-4be2-8332-2a1976e80074 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:04.579166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:04.671815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e59e7-7927-4be2-8332-2a1976e80074 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:04.718423 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cf189-ddc5-4b92-a949-ae03b0fa901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:04.719347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cf189-ddc5-4b92-a949-ae03b0fa901d None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:04.719689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cf189-ddc5-4b92-a949-ae03b0fa901d None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:04.719959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cf189-ddc5-4b92-a949-ae03b0fa901d None admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:04.720728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cf189-ddc5-4b92-a949-ae03b0fa901d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:04.721120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cf189-ddc5-4b92-a949-ae03b0fa901d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:04.722533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cf189-ddc5-4b92-a949-ae03b0fa901d None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:04.732932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 624/1264] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:04.739947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf8bae-1197-4cc1-b546-3060a828b313 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:04.813447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:04.856732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf8bae-1197-4cc1-b546-3060a828b313 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:04.891704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021357fe-ac8e-442b-850d-9cb8f65727b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:04.892508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021357fe-ac8e-442b-850d-9cb8f65727b2 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:04.892783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021357fe-ac8e-442b-850d-9cb8f65727b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:04.893058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021357fe-ac8e-442b-850d-9cb8f65727b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:04.905626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021357fe-ac8e-442b-850d-9cb8f65727b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:04.907096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021357fe-ac8e-442b-850d-9cb8f65727b2 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-021357fe-ac8e-442b-850d-9cb8f65727b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:47:04.925392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:04.927342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:04.928310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:47:04.928310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:47:04.928310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:04.928310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:47:04.928310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 641/1265] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:47:04.932947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cf189-ddc5-4b92-a949-ae03b0fa901d None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:05.017918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:05.047924 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cf189-ddc5-4b92-a949-ae03b0fa901d None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:05.090367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b7173-cf75-4ea1-8a03-fc4fc058264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:05.090988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b7173-cf75-4ea1-8a03-fc4fc058264f None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:05.091268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b7173-cf75-4ea1-8a03-fc4fc058264f None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:05.091537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b7173-cf75-4ea1-8a03-fc4fc058264f None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:05.092294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b7173-cf75-4ea1-8a03-fc4fc058264f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:05.092598 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b7173-cf75-4ea1-8a03-fc4fc058264f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:05.093985 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b7173-cf75-4ea1-8a03-fc4fc058264f None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:05.106242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 625/1266] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:05.112099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021357fe-ac8e-442b-850d-9cb8f65727b2 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:05.217665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021357fe-ac8e-442b-850d-9cb8f65727b2 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:05.240371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:05.260965 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc14a26-d90b-4db2-97b8-ff4ae4354253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:05.261952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc14a26-d90b-4db2-97b8-ff4ae4354253 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:05.261952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc14a26-d90b-4db2-97b8-ff4ae4354253 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:05.262505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc14a26-d90b-4db2-97b8-ff4ae4354253 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:05.273247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc14a26-d90b-4db2-97b8-ff4ae4354253 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:05.275431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc14a26-d90b-4db2-97b8-ff4ae4354253 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-0fc14a26-d90b-4db2-97b8-ff4ae4354253 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:47:05.292578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:05.298224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:47:05.300117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 642/1267] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:47:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:05.301418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b7173-cf75-4ea1-8a03-fc4fc058264f None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:05.417167 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b7173-cf75-4ea1-8a03-fc4fc058264f None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:05.458834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1280c4-2756-48d6-9c3d-3af081ca1f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:05.459775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1280c4-2756-48d6-9c3d-3af081ca1f1b None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:05.460064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1280c4-2756-48d6-9c3d-3af081ca1f1b None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:05.460531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1280c4-2756-48d6-9c3d-3af081ca1f1b None admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:05.462747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1280c4-2756-48d6-9c3d-3af081ca1f1b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:05.463271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1280c4-2756-48d6-9c3d-3af081ca1f1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:05.465895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1280c4-2756-48d6-9c3d-3af081ca1f1b None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:05.478625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:05.488054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 626/1268] 10.222.0.93 () {56 vars in 1143 bytes} [Thu May 26 16:47:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:05.494556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc14a26-d90b-4db2-97b8-ff4ae4354253 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:05.606337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc14a26-d90b-4db2-97b8-ff4ae4354253 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:05.645430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9771-959b-404e-8cc2-180459627255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:05.646255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9771-959b-404e-8cc2-180459627255 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:05.646533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9771-959b-404e-8cc2-180459627255 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:05.646805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9771-959b-404e-8cc2-180459627255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:05.658739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e9771-959b-404e-8cc2-180459627255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:05.660243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e9771-959b-404e-8cc2-180459627255 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-a00e9771-959b-404e-8cc2-180459627255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:47:05.680849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:05.682444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:05.683929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:47:05.683929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:47:05.683929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:05.683929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:47:05.683929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 643/1269] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:05.687989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1280c4-2756-48d6-9c3d-3af081ca1f1b None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:05.806225 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1280c4-2756-48d6-9c3d-3af081ca1f1b None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:05.849329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de6e25-dc96-4702-90e1-83d932d66803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:05.850059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de6e25-dc96-4702-90e1-83d932d66803 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:05.850382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de6e25-dc96-4702-90e1-83d932d66803 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:05.850687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de6e25-dc96-4702-90e1-83d932d66803 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:05.851964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de6e25-dc96-4702-90e1-83d932d66803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:05.852256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de6e25-dc96-4702-90e1-83d932d66803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:05.853673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de6e25-dc96-4702-90e1-83d932d66803 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:05.871627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 627/1270] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:05.874624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9771-959b-404e-8cc2-180459627255 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:05.908558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:05.990339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9771-959b-404e-8cc2-180459627255 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:06.033640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56c44-a7f5-4d8f-a719-7230076a7617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:06.034445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56c44-a7f5-4d8f-a719-7230076a7617 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:06.034724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56c44-a7f5-4d8f-a719-7230076a7617 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:06.035018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56c44-a7f5-4d8f-a719-7230076a7617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:06.043146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56c44-a7f5-4d8f-a719-7230076a7617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:06.044776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56c44-a7f5-4d8f-a719-7230076a7617 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-92d56c44-a7f5-4d8f-a719-7230076a7617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:47:06.060871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:06.061929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:06.064335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:47:06.064335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:47:06.064335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:47:06.064335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:47:06.064335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:47:06.064335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:47:06.064335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:47:06.064335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:47:06.064335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 644/1271] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:06.069115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de6e25-dc96-4702-90e1-83d932d66803 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:06.138685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:06.187139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de6e25-dc96-4702-90e1-83d932d66803 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:06.223782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd0bf2-899c-41b8-b4c9-5603650a90e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:06.224458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd0bf2-899c-41b8-b4c9-5603650a90e4 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:06.224745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd0bf2-899c-41b8-b4c9-5603650a90e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:06.225017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd0bf2-899c-41b8-b4c9-5603650a90e4 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:06.225809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd0bf2-899c-41b8-b4c9-5603650a90e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:06.226121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd0bf2-899c-41b8-b4c9-5603650a90e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:06.228274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd0bf2-899c-41b8-b4c9-5603650a90e4 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:06.249670 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 628/1272] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:47:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:06.250893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56c44-a7f5-4d8f-a719-7230076a7617 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:06.353975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:06.364917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56c44-a7f5-4d8f-a719-7230076a7617 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:06.399797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec5d81-bc8d-42ff-9f25-0f55f84151eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:06.400679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec5d81-bc8d-42ff-9f25-0f55f84151eb None admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:06.400962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec5d81-bc8d-42ff-9f25-0f55f84151eb None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:06.401234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec5d81-bc8d-42ff-9f25-0f55f84151eb None admin] PATH_INFO: `/v3/projects/b4c6817f30f44a419df3cf313c189439/users/bae184afff284dcaa228859902e92191/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:06.403397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec5d81-bc8d-42ff-9f25-0f55f84151eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b4c6817f30f44a419df3cf313c189439, user_id=bae184afff284dcaa228859902e92191, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:06.404852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec5d81-bc8d-42ff-9f25-0f55f84151eb None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:06.557148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 645/1273] 10.222.0.93 () {58 vars in 1439 bytes} [Thu May 26 16:47:06 2022] PUT /identity/v3/projects/b4c6817f30f44a419df3cf313c189439/users/bae184afff284dcaa228859902e92191/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:47:08.822014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5c877-053c-46df-a4fc-791cce86ccf5 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:08.822572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5c877-053c-46df-a4fc-791cce86ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:08.822572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5c877-053c-46df-a4fc-791cce86ccf5 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:08.823989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 629/1274] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:08.829290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971973f9-27c3-4ad6-b683-1ed3d9a3f9d7 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:08.829705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971973f9-27c3-4ad6-b683-1ed3d9a3f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:08.829849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971973f9-27c3-4ad6-b683-1ed3d9a3f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:08.847078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-971973f9-27c3-4ad6-b683-1ed3d9a3f9d7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:08.848323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-971973f9-27c3-4ad6-b683-1ed3d9a3f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:08.916626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 646/1275] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:47:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:47:08.940638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5c877-053c-46df-a4fc-791cce86ccf5 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:09.040986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5c877-053c-46df-a4fc-791cce86ccf5 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:09.058701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:09.075257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718e018-cb8a-45c2-9ee2-edfbd3b3b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:09.076079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718e018-cb8a-45c2-9ee2-edfbd3b3b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:09.076363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718e018-cb8a-45c2-9ee2-edfbd3b3b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:09.076638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718e018-cb8a-45c2-9ee2-edfbd3b3b0c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:09.087422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718e018-cb8a-45c2-9ee2-edfbd3b3b0c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-c718e018-cb8a-45c2-9ee2-edfbd3b3b0c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:47:09.095294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:09.096397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:09.097312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 630/1276] 10.222.0.93 () {56 vars in 1096 bytes} [Thu May 26 16:47:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:09.103435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971973f9-27c3-4ad6-b683-1ed3d9a3f9d7 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:09.186010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:09.204852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971973f9-27c3-4ad6-b683-1ed3d9a3f9d7 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:09.244960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556fad5-2697-4daf-bb06-984946ba18fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:09.245732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556fad5-2697-4daf-bb06-984946ba18fc None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:09.246021 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556fad5-2697-4daf-bb06-984946ba18fc None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:09.246294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556fad5-2697-4daf-bb06-984946ba18fc None admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:09.247038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556fad5-2697-4daf-bb06-984946ba18fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:09.247343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556fad5-2697-4daf-bb06-984946ba18fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:09.248757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556fad5-2697-4daf-bb06-984946ba18fc None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:09.256802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 647/1277] 10.222.0.93 () {56 vars in 1099 bytes} [Thu May 26 16:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:09.263070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718e018-cb8a-45c2-9ee2-edfbd3b3b0c5 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:09.376598 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718e018-cb8a-45c2-9ee2-edfbd3b3b0c5 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:09.411206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca26c7-bbe9-4caf-bca3-d9d828449cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:09.412014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca26c7-bbe9-4caf-bca3-d9d828449cae None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:09.412298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca26c7-bbe9-4caf-bca3-d9d828449cae None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:09.412573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca26c7-bbe9-4caf-bca3-d9d828449cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:09.424537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca26c7-bbe9-4caf-bca3-d9d828449cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:09.429464 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca26c7-bbe9-4caf-bca3-d9d828449cae None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-05ca26c7-bbe9-4caf-bca3-d9d828449cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:47:09.446775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:09.448114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:09.449070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:47:09.449070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:47:09.449070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:09.449070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:09.449070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 631/1278] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:09.454059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556fad5-2697-4daf-bb06-984946ba18fc None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:09.575961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556fad5-2697-4daf-bb06-984946ba18fc None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:09.616362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2096a-70d9-43d1-9ec5-583a63976c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:09.617065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2096a-70d9-43d1-9ec5-583a63976c77 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:09.617350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2096a-70d9-43d1-9ec5-583a63976c77 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:09.617624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2096a-70d9-43d1-9ec5-583a63976c77 None admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:09.618361 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2096a-70d9-43d1-9ec5-583a63976c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:09.618666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2096a-70d9-43d1-9ec5-583a63976c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:09.620099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2096a-70d9-43d1-9ec5-583a63976c77 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:09.633747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 648/1279] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:09.640937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca26c7-bbe9-4caf-bca3-d9d828449cae None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:09.680985 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:09.767973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca26c7-bbe9-4caf-bca3-d9d828449cae None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:09.806442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac10c70-70a3-4cd3-b0b7-29418b020f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:09.807474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac10c70-70a3-4cd3-b0b7-29418b020f4e None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:09.807790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac10c70-70a3-4cd3-b0b7-29418b020f4e None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:09.808149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac10c70-70a3-4cd3-b0b7-29418b020f4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:09.815948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac10c70-70a3-4cd3-b0b7-29418b020f4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:09.817445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac10c70-70a3-4cd3-b0b7-29418b020f4e None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-9ac10c70-70a3-4cd3-b0b7-29418b020f4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:47:09.836845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:09.839368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:09.840664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 632/1280] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:47:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:09.842969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2096a-70d9-43d1-9ec5-583a63976c77 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:09.847478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:09.952548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2096a-70d9-43d1-9ec5-583a63976c77 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:09.990341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b89f-e836-41f0-8ddd-73e95cfa53af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:09.991103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b89f-e836-41f0-8ddd-73e95cfa53af None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:09.991406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b89f-e836-41f0-8ddd-73e95cfa53af None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:09.991708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b89f-e836-41f0-8ddd-73e95cfa53af None admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:09.993116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b89f-e836-41f0-8ddd-73e95cfa53af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:09.993421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b89f-e836-41f0-8ddd-73e95cfa53af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:09.994857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b89f-e836-41f0-8ddd-73e95cfa53af None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:10.014419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 649/1281] 10.222.0.93 () {56 vars in 1143 bytes} [Thu May 26 16:47:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:10.020638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac10c70-70a3-4cd3-b0b7-29418b020f4e None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:10.134101 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:10.144044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac10c70-70a3-4cd3-b0b7-29418b020f4e None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:10.180226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab986-db11-46e3-8923-6f0eecdf7f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:10.180880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab986-db11-46e3-8923-6f0eecdf7f85 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:10.181166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab986-db11-46e3-8923-6f0eecdf7f85 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:10.181445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab986-db11-46e3-8923-6f0eecdf7f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:10.261403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbab986-db11-46e3-8923-6f0eecdf7f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:10.262895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbab986-db11-46e3-8923-6f0eecdf7f85 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:10.365943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:10.376874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 633/1282] 10.222.0.93 () {58 vars in 1282 bytes} [Thu May 26 16:47:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:47:10.384267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b89f-e836-41f0-8ddd-73e95cfa53af None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:10.456287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:10.498443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b89f-e836-41f0-8ddd-73e95cfa53af None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:10.536448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbc291-a5af-490e-aa81-daa8ffa45a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:10.537705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbc291-a5af-490e-aa81-daa8ffa45a15 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:10.538540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbc291-a5af-490e-aa81-daa8ffa45a15 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:10.539117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbc291-a5af-490e-aa81-daa8ffa45a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:10.552120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbc291-a5af-490e-aa81-daa8ffa45a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:10.553971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbc291-a5af-490e-aa81-daa8ffa45a15 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-93fbc291-a5af-490e-aa81-daa8ffa45a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:47:10.574435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:10.575491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:10.576517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:47:10.576517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:47:10.576517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:47:10.576517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:47:10.576517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 650/1283] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:10.581696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab986-db11-46e3-8923-6f0eecdf7f85 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:10.689809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab986-db11-46e3-8923-6f0eecdf7f85 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:10.728700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32d791-048d-4e75-8262-4c9644ae09d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:10.729366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32d791-048d-4e75-8262-4c9644ae09d1 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:10.729654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32d791-048d-4e75-8262-4c9644ae09d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:10.729935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32d791-048d-4e75-8262-4c9644ae09d1 None admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:10.730666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32d791-048d-4e75-8262-4c9644ae09d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:10.730976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32d791-048d-4e75-8262-4c9644ae09d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:10.732565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32d791-048d-4e75-8262-4c9644ae09d1 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:10.745536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 634/1284] 10.222.0.93 () {56 vars in 1109 bytes} [Thu May 26 16:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:10.751415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbc291-a5af-490e-aa81-daa8ffa45a15 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:10.870661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbc291-a5af-490e-aa81-daa8ffa45a15 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:10.888450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:10.911814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48ad3f-f829-4597-a831-fe72055b75b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:10.912643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48ad3f-f829-4597-a831-fe72055b75b3 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:10.912926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48ad3f-f829-4597-a831-fe72055b75b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:10.913201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48ad3f-f829-4597-a831-fe72055b75b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:10.921667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48ad3f-f829-4597-a831-fe72055b75b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:10.923386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48ad3f-f829-4597-a831-fe72055b75b3 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application [None req-9e48ad3f-f829-4597-a831-fe72055b75b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:47:10.941098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application with Lock( May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:10.942582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:10.943751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:47:10.943751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:47:10.943751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:47:10.943751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:47:10.943751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:47:10.943751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:47:10.943751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:47:10.943751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: ERROR keystone.server.flask.application May 26 16:47:10.943751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 651/1285] 10.222.0.93 () {56 vars in 1111 bytes} [Thu May 26 16:47:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:10.949820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32d791-048d-4e75-8262-4c9644ae09d1 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:11.012252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:11.077499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32d791-048d-4e75-8262-4c9644ae09d1 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:11.133192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8f700-7b7a-4576-95b1-0a596c044f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:11.133857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8f700-7b7a-4576-95b1-0a596c044f62 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:11.134136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8f700-7b7a-4576-95b1-0a596c044f62 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:11.134431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8f700-7b7a-4576-95b1-0a596c044f62 None admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:11.135199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8f700-7b7a-4576-95b1-0a596c044f62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:11.135502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8f700-7b7a-4576-95b1-0a596c044f62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:11.137017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8f700-7b7a-4576-95b1-0a596c044f62 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:11.149807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 635/1286] 10.222.0.93 () {56 vars in 1148 bytes} [Thu May 26 16:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:11.156071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48ad3f-f829-4597-a831-fe72055b75b3 None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:11.260526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48ad3f-f829-4597-a831-fe72055b75b3 None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:11.295572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447129f-dc69-4b44-8eb1-5c87bd709c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:11.296234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447129f-dc69-4b44-8eb1-5c87bd709c24 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:11.296510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447129f-dc69-4b44-8eb1-5c87bd709c24 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:11.296819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447129f-dc69-4b44-8eb1-5c87bd709c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:11.297640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447129f-dc69-4b44-8eb1-5c87bd709c24 None admin] RBAC: Adding query filter params (role.id=0929ca3f300846b0915f3e24f5ffd382, scope.project.id=b4c6817f30f44a419df3cf313c189439, user.id=bae184afff284dcaa228859902e92191) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:11.297950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447129f-dc69-4b44-8eb1-5c87bd709c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:11.299407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447129f-dc69-4b44-8eb1-5c87bd709c24 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:11.306562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 652/1287] 10.222.0.93 () {56 vars in 1374 bytes} [Thu May 26 16:47:11 2022] GET /identity/v3/role_assignments?user.id=bae184afff284dcaa228859902e92191&scope.project.id=b4c6817f30f44a419df3cf313c189439&role.id=0929ca3f300846b0915f3e24f5ffd382 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:13.570673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1f3a3-7851-4896-ad3c-4fb9656bf4f5 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:13.571246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1f3a3-7851-4896-ad3c-4fb9656bf4f5 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:13.571246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1f3a3-7851-4896-ad3c-4fb9656bf4f5 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:13.572654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 636/1288] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:13.578087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcccefb-4794-4d92-826b-64d3f6ec2791 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:13.578531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcccefb-4794-4d92-826b-64d3f6ec2791 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:13.578654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcccefb-4794-4d92-826b-64d3f6ec2791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:13.596603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-ffcccefb-4794-4d92-826b-64d3f6ec2791 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:13.598224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ffcccefb-4794-4d92-826b-64d3f6ec2791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:13.629711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:13.671014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 653/1289] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:47:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:47:13.693522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1f3a3-7851-4896-ad3c-4fb9656bf4f5 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:13.805827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1f3a3-7851-4896-ad3c-4fb9656bf4f5 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:13.819168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:13.845257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f09215-1e53-4507-adab-2a691b070835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:13.845971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f09215-1e53-4507-adab-2a691b070835 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:13.846248 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f09215-1e53-4507-adab-2a691b070835 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:13.846515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f09215-1e53-4507-adab-2a691b070835 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:13.847172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f09215-1e53-4507-adab-2a691b070835 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:13.848642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f09215-1e53-4507-adab-2a691b070835 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-58f09215-1e53-4507-adab-2a691b070835 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:13.861221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:13.862880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:13.864023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 637/1290] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:47:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:13.869612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcccefb-4794-4d92-826b-64d3f6ec2791 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:13.974843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcccefb-4794-4d92-826b-64d3f6ec2791 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:14.009376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e336ad-c96a-447a-930f-3be38f997056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:14.010030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e336ad-c96a-447a-930f-3be38f997056 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:14.010314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e336ad-c96a-447a-930f-3be38f997056 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:14.010590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e336ad-c96a-447a-930f-3be38f997056 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:14.011292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e336ad-c96a-447a-930f-3be38f997056 None admin] RBAC: Adding query filter params (name=placement) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:14.011621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e336ad-c96a-447a-930f-3be38f997056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:14.012995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e336ad-c96a-447a-930f-3be38f997056 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:14.017814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 654/1291] 10.222.0.93 () {56 vars in 1116 bytes} [Thu May 26 16:47:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:14.023706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f09215-1e53-4507-adab-2a691b070835 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:14.125549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f09215-1e53-4507-adab-2a691b070835 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:14.159148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fd8fa-b99a-4867-a3c3-c15a6e9cbeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:14.159858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fd8fa-b99a-4867-a3c3-c15a6e9cbeb6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:14.160136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fd8fa-b99a-4867-a3c3-c15a6e9cbeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:14.160410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fd8fa-b99a-4867-a3c3-c15a6e9cbeb6 None admin] PATH_INFO: `/v3/services` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:14.162263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fd8fa-b99a-4867-a3c3-c15a6e9cbeb6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:14.162567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fd8fa-b99a-4867-a3c3-c15a6e9cbeb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:14.164519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fd8fa-b99a-4867-a3c3-c15a6e9cbeb6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:14.169395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 638/1292] 10.222.0.93 () {56 vars in 1116 bytes} [Thu May 26 16:47:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:16.451398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70da35-20c6-45e5-b305-84bd1f4f15ab None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:16.452343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70da35-20c6-45e5-b305-84bd1f4f15ab None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:16.452461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70da35-20c6-45e5-b305-84bd1f4f15ab None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:16.455013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 655/1293] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:47:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:16.463517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868503dd-43df-435e-8786-84b9d36cc1e3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:16.464079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868503dd-43df-435e-8786-84b9d36cc1e3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:16.464209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868503dd-43df-435e-8786-84b9d36cc1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:16.482256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-868503dd-43df-435e-8786-84b9d36cc1e3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:16.483480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-868503dd-43df-435e-8786-84b9d36cc1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:16.522979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:16.578951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 639/1294] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:47:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:47:16.602428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70da35-20c6-45e5-b305-84bd1f4f15ab None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:16.634499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:16.711661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70da35-20c6-45e5-b305-84bd1f4f15ab None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:16.748410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0bfd8-d144-4644-a660-9886d66ec57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:16.752264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0bfd8-d144-4644-a660-9886d66ec57b None admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:16.752264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0bfd8-d144-4644-a660-9886d66ec57b None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:16.752264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0bfd8-d144-4644-a660-9886d66ec57b None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:16.752264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0bfd8-d144-4644-a660-9886d66ec57b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:16.752864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0bfd8-d144-4644-a660-9886d66ec57b None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:16.882075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 656/1295] 10.222.0.93 () {60 vars in 1141 bytes} [Thu May 26 16:47:16 2022] POST /identity/v3/services => generated 246 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:47:19.267419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e812a-e9ef-4c53-b0ce-8ed69247c66b None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:19.268060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e812a-e9ef-4c53-b0ce-8ed69247c66b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:19.268060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e812a-e9ef-4c53-b0ce-8ed69247c66b None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:19.269917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 640/1296] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:19.276007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1570-8b41-4cce-bb52-27941333f761 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:19.276581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1570-8b41-4cce-bb52-27941333f761 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:19.276581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1570-8b41-4cce-bb52-27941333f761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:19.295128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-520c1570-8b41-4cce-bb52-27941333f761 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:19.296414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-520c1570-8b41-4cce-bb52-27941333f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:19.403609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 657/1297] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:47:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:47:19.427806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e812a-e9ef-4c53-b0ce-8ed69247c66b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:19.554879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e812a-e9ef-4c53-b0ce-8ed69247c66b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:19.608857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff283e-dd4c-4ea3-bb65-841634666df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:19.610144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff283e-dd4c-4ea3-bb65-841634666df6 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:19.610607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff283e-dd4c-4ea3-bb65-841634666df6 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:19.611054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff283e-dd4c-4ea3-bb65-841634666df6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:19.611912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff283e-dd4c-4ea3-bb65-841634666df6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:19.614322 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff283e-dd4c-4ea3-bb65-841634666df6 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-a2ff283e-dd4c-4ea3-bb65-841634666df6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:19.634131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:19.635797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:19.637380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 641/1298] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:47:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:19.644937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1570-8b41-4cce-bb52-27941333f761 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:19.666108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:19.762847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1570-8b41-4cce-bb52-27941333f761 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:19.802259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af6e57-3764-45fb-9d9a-0b6c59b3fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:19.802928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af6e57-3764-45fb-9d9a-0b6c59b3fb1c None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:19.803205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af6e57-3764-45fb-9d9a-0b6c59b3fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:19.803473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af6e57-3764-45fb-9d9a-0b6c59b3fb1c None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:19.804314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af6e57-3764-45fb-9d9a-0b6c59b3fb1c None admin] RBAC: Adding query filter params (name=placement) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:19.804666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af6e57-3764-45fb-9d9a-0b6c59b3fb1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:19.806108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af6e57-3764-45fb-9d9a-0b6c59b3fb1c None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:19.813754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 658/1299] 10.222.0.93 () {56 vars in 1116 bytes} [Thu May 26 16:47:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:47:19.820365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff283e-dd4c-4ea3-bb65-841634666df6 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:19.857347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:19.934739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff283e-dd4c-4ea3-bb65-841634666df6 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:19.973451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f28d82-800e-4132-8ec1-d01e0058039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:19.974157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f28d82-800e-4132-8ec1-d01e0058039a None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:19.974446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f28d82-800e-4132-8ec1-d01e0058039a None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:19.974719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f28d82-800e-4132-8ec1-d01e0058039a None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:19.975520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f28d82-800e-4132-8ec1-d01e0058039a None admin] RBAC: Adding query filter params (interface=public, service_id=3922c9152e614020808aa124bcf4a0e4, region_id=RegionOne) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:19.975867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f28d82-800e-4132-8ec1-d01e0058039a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:19.978125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f28d82-800e-4132-8ec1-d01e0058039a None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:19.984160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 642/1300] 10.222.0.93 () {56 vars in 1251 bytes} [Thu May 26 16:47:19 2022] GET /identity/v3/endpoints?service_id=3922c9152e614020808aa124bcf4a0e4&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:19.991705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af6e57-3764-45fb-9d9a-0b6c59b3fb1c None admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:20.105330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:20.126380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af6e57-3764-45fb-9d9a-0b6c59b3fb1c None admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:20.177157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285014d-9711-4df1-b8c7-649704908290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:20.177852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285014d-9711-4df1-b8c7-649704908290 None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:20.178514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285014d-9711-4df1-b8c7-649704908290 None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:20.178799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285014d-9711-4df1-b8c7-649704908290 None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:20.179539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285014d-9711-4df1-b8c7-649704908290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:20.181136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285014d-9711-4df1-b8c7-649704908290 None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:20.191177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 659/1301] 10.222.0.93 () {56 vars in 1087 bytes} [Thu May 26 16:47:19 2022] GET /identity/v3/services => generated 2191 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:47:22.481454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa59e7-b715-4e81-8133-afe611e61b84 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:22.482172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa59e7-b715-4e81-8133-afe611e61b84 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:22.482172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa59e7-b715-4e81-8133-afe611e61b84 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:22.483405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 643/1302] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:22.488809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2258dbf-38ae-442f-ab35-020161bebdd3 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:22.489263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2258dbf-38ae-442f-ab35-020161bebdd3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:22.489355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2258dbf-38ae-442f-ab35-020161bebdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:22.505670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c2258dbf-38ae-442f-ab35-020161bebdd3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:22.507590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c2258dbf-38ae-442f-ab35-020161bebdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:22.577063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 660/1303] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:47:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:47:22.601280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa59e7-b715-4e81-8133-afe611e61b84 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:22.705833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:22.713599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa59e7-b715-4e81-8133-afe611e61b84 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:22.750181 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b42a3-e4f3-46ec-ae25-03d64c6cf022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:22.750951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b42a3-e4f3-46ec-ae25-03d64c6cf022 None admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:22.751242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b42a3-e4f3-46ec-ae25-03d64c6cf022 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:22.751522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b42a3-e4f3-46ec-ae25-03d64c6cf022 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:22.752224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b42a3-e4f3-46ec-ae25-03d64c6cf022 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:22.753742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b42a3-e4f3-46ec-ae25-03d64c6cf022 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application [None req-115b42a3-e4f3-46ec-ae25-03d64c6cf022 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:47:22.766556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:47:22.767993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application with Lock( May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self._enter() May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application return self.creator() May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application created_value = creator( May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: ERROR keystone.server.flask.application May 26 16:47:22.768872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 644/1304] 10.222.0.93 () {56 vars in 1117 bytes} [Thu May 26 16:47:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:47:22.774276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2258dbf-38ae-442f-ab35-020161bebdd3 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:22.858744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:22.883149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2258dbf-38ae-442f-ab35-020161bebdd3 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:22.922912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4d508-139e-4d0b-8bf4-5e9aeb63443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:22.924068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4d508-139e-4d0b-8bf4-5e9aeb63443a None admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:22.924538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4d508-139e-4d0b-8bf4-5e9aeb63443a None admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:22.924989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4d508-139e-4d0b-8bf4-5e9aeb63443a None admin] PATH_INFO: `/v3/services` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:22.926197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4d508-139e-4d0b-8bf4-5e9aeb63443a None admin] RBAC: Adding query filter params (name=placement) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:47:22.926822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4d508-139e-4d0b-8bf4-5e9aeb63443a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:22.929947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4d508-139e-4d0b-8bf4-5e9aeb63443a None admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:22.936938 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 661/1305] 10.222.0.93 () {56 vars in 1116 bytes} [Thu May 26 16:47:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:47:22.942837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b42a3-e4f3-46ec-ae25-03d64c6cf022 None admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:23.063858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b42a3-e4f3-46ec-ae25-03d64c6cf022 None admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:23.108968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbaf1f-5c04-4350-9c51-c390e72f52a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:23.110157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbaf1f-5c04-4350-9c51-c390e72f52a3 None admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:23.110555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbaf1f-5c04-4350-9c51-c390e72f52a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:23.111005 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbaf1f-5c04-4350-9c51-c390e72f52a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:23.112441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbaf1f-5c04-4350-9c51-c390e72f52a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:23.113937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbaf1f-5c04-4350-9c51-c390e72f52a3 None admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:23.233438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 645/1306] 10.222.0.93 () {60 vars in 1144 bytes} [Thu May 26 16:47:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:47:32.938069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=30 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:33.224710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:47.876929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcfb47-05b4-4b47-9946-6e0e3ec860ff None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.877544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcfb47-05b4-4b47-9946-6e0e3ec860ff None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.877544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcfb47-05b4-4b47-9946-6e0e3ec860ff None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.885224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53beaa-c347-4bb5-a3b3-23e07a61a9fa None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:47.885944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53beaa-c347-4bb5-a3b3-23e07a61a9fa None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:47.885944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53beaa-c347-4bb5-a3b3-23e07a61a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:47.889693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 662/1307] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:54:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:54:47.974210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-bf53beaa-c347-4bb5-a3b3-23e07a61a9fa None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:47.975354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bf53beaa-c347-4bb5-a3b3-23e07a61a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:48.116108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 646/1308] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:48.158837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e214bac-e1e3-4aae-845f-db2fb1673f16 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.159146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e214bac-e1e3-4aae-845f-db2fb1673f16 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.159397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e214bac-e1e3-4aae-845f-db2fb1673f16 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.160848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 663/1309] 10.222.0.93 () {54 vars in 964 bytes} [Thu May 26 16:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:54:48.167937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520f90a-871e-4d27-a99a-f982ac9ecebb None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.168512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520f90a-871e-4d27-a99a-f982ac9ecebb None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.168974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520f90a-871e-4d27-a99a-f982ac9ecebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.273367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1520f90a-871e-4d27-a99a-f982ac9ecebb None None] MFA Rules not processed for user `8fee665c10364944a8162548f91a431e`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:48.275187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1520f90a-871e-4d27-a99a-f982ac9ecebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:48.301898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:48.374814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 647/1310] 10.222.0.93 () {58 vars in 1061 bytes} [Thu May 26 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:48.387301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e214bac-e1e3-4aae-845f-db2fb1673f16 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:48.389129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6e214bac-e1e3-4aae-845f-db2fb1673f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:48.538915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e214bac-e1e3-4aae-845f-db2fb1673f16 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:48.653006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861932b-e68e-4abc-878f-48afaacbbbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:48.653687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861932b-e68e-4abc-878f-48afaacbbbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:48.653960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861932b-e68e-4abc-878f-48afaacbbbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:48.654234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861932b-e68e-4abc-878f-48afaacbbbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:48.656004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d861932b-e68e-4abc-878f-48afaacbbbf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:48.723337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:48.789578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861932b-e68e-4abc-878f-48afaacbbbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:48.791047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861932b-e68e-4abc-878f-48afaacbbbf7 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:48.813068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 664/1311] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:51.626764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a28a7-edc4-4ee4-af63-69e7a376aba6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:51.627276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a28a7-edc4-4ee4-af63-69e7a376aba6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:51.627380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a28a7-edc4-4ee4-af63-69e7a376aba6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:51.629378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 648/1312] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:54:51.636113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6125fc-147d-44e8-a3fb-c1bfaed963a6 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:51.636678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6125fc-147d-44e8-a3fb-c1bfaed963a6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:51.636678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6125fc-147d-44e8-a3fb-c1bfaed963a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:51.743018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-0a6125fc-147d-44e8-a3fb-c1bfaed963a6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:51.744433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-0a6125fc-147d-44e8-a3fb-c1bfaed963a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:51.864206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 665/1313] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:51.922471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a28a7-edc4-4ee4-af63-69e7a376aba6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:51.925433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1a1a28a7-edc4-4ee4-af63-69e7a376aba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:52.077995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a28a7-edc4-4ee4-af63-69e7a376aba6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:52.202427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:52.205829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70706a3-d9ee-49d2-8ba8-ea91edf12014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:52.206738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70706a3-d9ee-49d2-8ba8-ea91edf12014 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:52.207030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70706a3-d9ee-49d2-8ba8-ea91edf12014 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:52.207502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70706a3-d9ee-49d2-8ba8-ea91edf12014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:52.209235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f70706a3-d9ee-49d2-8ba8-ea91edf12014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:52.365163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70706a3-d9ee-49d2-8ba8-ea91edf12014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:52.366647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70706a3-d9ee-49d2-8ba8-ea91edf12014 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:52.396351 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 649/1314] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:55.543392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72287a6-3731-4445-91bc-73209cc8818a None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:55.543977 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72287a6-3731-4445-91bc-73209cc8818a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:55.544075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72287a6-3731-4445-91bc-73209cc8818a None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:55.545596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 666/1315] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:54:55.553591 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425879d-9a91-488c-9b3a-5acc6e557463 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:55.554147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425879d-9a91-488c-9b3a-5acc6e557463 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:55.554594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425879d-9a91-488c-9b3a-5acc6e557463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:55.631306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-6425879d-9a91-488c-9b3a-5acc6e557463 None None] MFA Rules not processed for user `f0bc925e5a06416393e984ad52522227`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:55.632688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6425879d-9a91-488c-9b3a-5acc6e557463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:55.698492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:55.755662 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 650/1316] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:55.798280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72287a6-3731-4445-91bc-73209cc8818a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:55.799217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c72287a6-3731-4445-91bc-73209cc8818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:55.809743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:55.915998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72287a6-3731-4445-91bc-73209cc8818a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:56.008116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbe346-6ab1-4a45-9f32-426144ec7403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:56.008774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbe346-6ab1-4a45-9f32-426144ec7403 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:56.009047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbe346-6ab1-4a45-9f32-426144ec7403 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:56.009321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbe346-6ab1-4a45-9f32-426144ec7403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:56.011054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-decbe346-6ab1-4a45-9f32-426144ec7403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:56.081655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:56.141801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbe346-6ab1-4a45-9f32-426144ec7403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:56.143256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbe346-6ab1-4a45-9f32-426144ec7403 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:56.162835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 667/1317] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:54:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:59.499433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ccfce-4998-4c3f-aa56-91bdad5c7843 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.500030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ccfce-4998-4c3f-aa56-91bdad5c7843 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.500030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ccfce-4998-4c3f-aa56-91bdad5c7843 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.501465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 651/1318] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:54:59.512521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878fa72-ab5f-463b-b2b0-bb6cb1e5c535 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.513081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878fa72-ab5f-463b-b2b0-bb6cb1e5c535 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.513573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878fa72-ab5f-463b-b2b0-bb6cb1e5c535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.640469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4878fa72-ab5f-463b-b2b0-bb6cb1e5c535 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:59.641916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4878fa72-ab5f-463b-b2b0-bb6cb1e5c535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:59.815772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 668/1319] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:54:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:59.898786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43afa6e-0b70-4da7-9127-c45f7ca1f91f None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.899073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43afa6e-0b70-4da7-9127-c45f7ca1f91f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.899358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43afa6e-0b70-4da7-9127-c45f7ca1f91f None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.901150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 652/1320] 10.222.0.93 () {54 vars in 964 bytes} [Thu May 26 16:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:54:59.908565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcba2-b802-4421-a3d0-d358900ad2fe None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.908942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcba2-b802-4421-a3d0-d358900ad2fe None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.910197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcba2-b802-4421-a3d0-d358900ad2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.945795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:00.008483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-429fcba2-b802-4421-a3d0-d358900ad2fe None None] MFA Rules not processed for user `8fee665c10364944a8162548f91a431e`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:00.009714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-429fcba2-b802-4421-a3d0-d358900ad2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:00.107953 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 669/1321] 10.222.0.93 () {58 vars in 1061 bytes} [Thu May 26 16:54:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:00.117929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43afa6e-0b70-4da7-9127-c45f7ca1f91f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:00.119605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a43afa6e-0b70-4da7-9127-c45f7ca1f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:00.239998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43afa6e-0b70-4da7-9127-c45f7ca1f91f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:00.347881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79828e0-12f0-42f2-8ecc-106cb505f0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:00.348933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79828e0-12f0-42f2-8ecc-106cb505f0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.349376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79828e0-12f0-42f2-8ecc-106cb505f0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.349789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79828e0-12f0-42f2-8ecc-106cb505f0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.352697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f79828e0-12f0-42f2-8ecc-106cb505f0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:00.363635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:00.491596 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79828e0-12f0-42f2-8ecc-106cb505f0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:00.493598 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79828e0-12f0-42f2-8ecc-106cb505f0b6 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:00.520197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 653/1322] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:04.598125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7621de4-bf7c-456a-8808-1d6e1cee7e06 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.598957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7621de4-bf7c-456a-8808-1d6e1cee7e06 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.598957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7621de4-bf7c-456a-8808-1d6e1cee7e06 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.600608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 670/1323] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:04.609288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b796c92-584f-49d9-93c3-c194cffb9592 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.610144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b796c92-584f-49d9-93c3-c194cffb9592 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.610301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b796c92-584f-49d9-93c3-c194cffb9592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.724017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8b796c92-584f-49d9-93c3-c194cffb9592 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:04.726059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8b796c92-584f-49d9-93c3-c194cffb9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:04.823008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:04.927116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 654/1324] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:04.986657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7621de4-bf7c-456a-8808-1d6e1cee7e06 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.988601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b7621de4-bf7c-456a-8808-1d6e1cee7e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.128876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7621de4-bf7c-456a-8808-1d6e1cee7e06 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.153821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:05.248922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73274c-8434-45ad-977c-d5d63a637306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.250059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73274c-8434-45ad-977c-d5d63a637306 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.250570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73274c-8434-45ad-977c-d5d63a637306 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.251069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73274c-8434-45ad-977c-d5d63a637306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.255098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9d73274c-8434-45ad-977c-d5d63a637306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.434815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73274c-8434-45ad-977c-d5d63a637306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.436607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73274c-8434-45ad-977c-d5d63a637306 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.468205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 671/1325] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:09.032656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fed19-a14c-44f5-8063-1e35205cd2b4 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.033307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fed19-a14c-44f5-8063-1e35205cd2b4 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.033578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fed19-a14c-44f5-8063-1e35205cd2b4 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.037275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 655/1326] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:09.043316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75581183-daf5-46c8-9eb5-e02bf0422ea1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.044163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75581183-daf5-46c8-9eb5-e02bf0422ea1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.044163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75581183-daf5-46c8-9eb5-e02bf0422ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.107321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:09.124552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-75581183-daf5-46c8-9eb5-e02bf0422ea1 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:09.125762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-75581183-daf5-46c8-9eb5-e02bf0422ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:09.281020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 672/1327] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:09.321353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fed19-a14c-44f5-8063-1e35205cd2b4 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:09.323051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7c6fed19-a14c-44f5-8063-1e35205cd2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:09.461011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fed19-a14c-44f5-8063-1e35205cd2b4 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:09.561499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e939-d13d-40af-93ba-3713f3d2d09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:09.562169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e939-d13d-40af-93ba-3713f3d2d09d service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.562456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e939-d13d-40af-93ba-3713f3d2d09d service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.562795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e939-d13d-40af-93ba-3713f3d2d09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.564522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a6d4e939-d13d-40af-93ba-3713f3d2d09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:09.594261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:09.719197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4e939-d13d-40af-93ba-3713f3d2d09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:09.720708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4e939-d13d-40af-93ba-3713f3d2d09d service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:09.743007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 656/1328] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:12.421009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873744c2-bd91-4ee4-90fc-38050534ac6d None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:12.421601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873744c2-bd91-4ee4-90fc-38050534ac6d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:12.421791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873744c2-bd91-4ee4-90fc-38050534ac6d None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:12.423221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 673/1329] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:12.429279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1047d-2886-4c9f-a4bb-8f9afa2e7e06 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:12.429815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1047d-2886-4c9f-a4bb-8f9afa2e7e06 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:12.429961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1047d-2886-4c9f-a4bb-8f9afa2e7e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:12.521212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-fda1047d-2886-4c9f-a4bb-8f9afa2e7e06 None None] MFA Rules not processed for user `f0bc925e5a06416393e984ad52522227`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:12.522462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fda1047d-2886-4c9f-a4bb-8f9afa2e7e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:12.632364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:12.692102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 657/1330] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:12.738374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873744c2-bd91-4ee4-90fc-38050534ac6d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:12.741141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-873744c2-bd91-4ee4-90fc-38050534ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:12.875332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873744c2-bd91-4ee4-90fc-38050534ac6d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:12.902096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:12.988113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d73c3-246f-4230-8bef-5eee67d813cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:12.988803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d73c3-246f-4230-8bef-5eee67d813cb service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:12.989240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d73c3-246f-4230-8bef-5eee67d813cb service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:12.989739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d73c3-246f-4230-8bef-5eee67d813cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:12.993160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-116d73c3-246f-4230-8bef-5eee67d813cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:13.194481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d73c3-246f-4230-8bef-5eee67d813cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:13.196372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d73c3-246f-4230-8bef-5eee67d813cb service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:13.221725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 674/1331] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:16.180298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a63279-f3ce-41f2-958e-bc324ab42f60 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:16.180298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a63279-f3ce-41f2-958e-bc324ab42f60 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:16.181826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a63279-f3ce-41f2-958e-bc324ab42f60 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:16.182595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 658/1332] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:16.188484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016fa04-1baf-46c6-be94-47f029870f60 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:16.189295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016fa04-1baf-46c6-be94-47f029870f60 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:16.189295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016fa04-1baf-46c6-be94-47f029870f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:16.286220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:16.289738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b016fa04-1baf-46c6-be94-47f029870f60 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:16.290982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b016fa04-1baf-46c6-be94-47f029870f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:16.480318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 675/1333] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:16.543271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a63279-f3ce-41f2-958e-bc324ab42f60 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:16.546127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-70a63279-f3ce-41f2-958e-bc324ab42f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:16.737031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a63279-f3ce-41f2-958e-bc324ab42f60 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:16.844457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37505d96-00ff-402a-a28f-94082bfd5d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:16.845112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505d96-00ff-402a-a28f-94082bfd5d74 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:16.845433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505d96-00ff-402a-a28f-94082bfd5d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:16.845715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505d96-00ff-402a-a28f-94082bfd5d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:16.847485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-37505d96-00ff-402a-a28f-94082bfd5d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:16.894139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:17.143965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37505d96-00ff-402a-a28f-94082bfd5d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:17.146500 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37505d96-00ff-402a-a28f-94082bfd5d74 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:17.175218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 659/1334] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:55:19.700438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ed16b-79ad-4d5b-bfd8-f96197f8a754 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:19.701061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ed16b-79ad-4d5b-bfd8-f96197f8a754 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:19.701061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ed16b-79ad-4d5b-bfd8-f96197f8a754 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:19.702467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 676/1335] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:19.708892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9982873-58f3-48fa-88a8-42e83153cb33 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:19.709600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9982873-58f3-48fa-88a8-42e83153cb33 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:19.709600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9982873-58f3-48fa-88a8-42e83153cb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:19.795864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e9982873-58f3-48fa-88a8-42e83153cb33 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:19.797089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e9982873-58f3-48fa-88a8-42e83153cb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:19.881045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:19.918684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 660/1336] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:19.961522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ed16b-79ad-4d5b-bfd8-f96197f8a754 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:19.963883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ba4ed16b-79ad-4d5b-bfd8-f96197f8a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:20.078655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ed16b-79ad-4d5b-bfd8-f96197f8a754 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:20.083398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d65689-12da-4e9d-88fc-edc7177a27e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:20.084108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65689-12da-4e9d-88fc-edc7177a27e4 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:20.084396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65689-12da-4e9d-88fc-edc7177a27e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:20.084677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65689-12da-4e9d-88fc-edc7177a27e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:20.095058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d65689-12da-4e9d-88fc-edc7177a27e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:20.096588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d65689-12da-4e9d-88fc-edc7177a27e4 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:20.108557 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 677/1337] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:23.222753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae229-f611-4b21-b717-826c985255d7 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:23.223359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae229-f611-4b21-b717-826c985255d7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:23.223359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae229-f611-4b21-b717-826c985255d7 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:23.224807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 661/1338] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:23.231160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd034d50-5121-482c-a929-4dfd1905ce55 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:23.231749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd034d50-5121-482c-a929-4dfd1905ce55 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:23.231749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd034d50-5121-482c-a929-4dfd1905ce55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:23.265382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-cd034d50-5121-482c-a929-4dfd1905ce55 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:23.266609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-cd034d50-5121-482c-a929-4dfd1905ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:23.291395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:23.365574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 678/1339] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:23.410424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ae229-f611-4b21-b717-826c985255d7 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:23.422375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ae229-f611-4b21-b717-826c985255d7 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:23.427300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83badd40-d9b3-42dd-83cf-b5b52b9bbfd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:23.428082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83badd40-d9b3-42dd-83cf-b5b52b9bbfd9 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:23.428403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83badd40-d9b3-42dd-83cf-b5b52b9bbfd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:23.428747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83badd40-d9b3-42dd-83cf-b5b52b9bbfd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:23.439825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83badd40-d9b3-42dd-83cf-b5b52b9bbfd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:23.441417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83badd40-d9b3-42dd-83cf-b5b52b9bbfd9 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:23.459907 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 662/1340] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:28.769553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0a5b3-c3bd-4581-b3b1-9d471be66b90 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:28.770308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0a5b3-c3bd-4581-b3b1-9d471be66b90 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:28.770308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0a5b3-c3bd-4581-b3b1-9d471be66b90 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:28.772039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 679/1341] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:55:28.779950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc38b04-d292-4716-8183-9aeeb786481f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:28.780790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc38b04-d292-4716-8183-9aeeb786481f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:28.780972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc38b04-d292-4716-8183-9aeeb786481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:28.805675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-dcc38b04-d292-4716-8183-9aeeb786481f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:28.807656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-dcc38b04-d292-4716-8183-9aeeb786481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:28.817464 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 663/1342] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:28.872490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0a5b3-c3bd-4581-b3b1-9d471be66b90 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:28.875465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-cdf0a5b3-c3bd-4581-b3b1-9d471be66b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:28.895711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0a5b3-c3bd-4581-b3b1-9d471be66b90 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:28.901564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af603428-5f80-46a9-ab58-df6992ac330f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:28.902574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af603428-5f80-46a9-ab58-df6992ac330f service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:28.902915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af603428-5f80-46a9-ab58-df6992ac330f service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:28.903594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af603428-5f80-46a9-ab58-df6992ac330f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:28.924291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af603428-5f80-46a9-ab58-df6992ac330f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:28.926203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af603428-5f80-46a9-ab58-df6992ac330f service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:28.948429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 680/1343] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:32.638909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7e331-0638-4a2b-9305-72c08cb31592 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.639436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7e331-0638-4a2b-9305-72c08cb31592 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.639883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7e331-0638-4a2b-9305-72c08cb31592 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.646275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 664/1344] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:32.658464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ff63b-be81-4a5e-a51a-f23bc096ae02 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.659198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ff63b-be81-4a5e-a51a-f23bc096ae02 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.659447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ff63b-be81-4a5e-a51a-f23bc096ae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.688350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b85ff63b-be81-4a5e-a51a-f23bc096ae02 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:32.689778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b85ff63b-be81-4a5e-a51a-f23bc096ae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:32.698292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 681/1345] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:32.737755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7e331-0638-4a2b-9305-72c08cb31592 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.750116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7e331-0638-4a2b-9305-72c08cb31592 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.754736 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d21bfb-c1ef-4669-bc2c-d70efd681a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.755539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d21bfb-c1ef-4669-bc2c-d70efd681a53 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.755955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d21bfb-c1ef-4669-bc2c-d70efd681a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.756334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d21bfb-c1ef-4669-bc2c-d70efd681a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.776111 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d21bfb-c1ef-4669-bc2c-d70efd681a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.778901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d21bfb-c1ef-4669-bc2c-d70efd681a53 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.791486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 665/1346] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:38.408640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce62b8-209c-42f7-8dc9-f4ea424ed879 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.409564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce62b8-209c-42f7-8dc9-f4ea424ed879 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.409837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce62b8-209c-42f7-8dc9-f4ea424ed879 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.411476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 682/1347] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:38.417782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b54b14-bbfc-43f4-95c5-5fc34e70c96b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.418557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b54b14-bbfc-43f4-95c5-5fc34e70c96b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.418557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b54b14-bbfc-43f4-95c5-5fc34e70c96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.440841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-64b54b14-bbfc-43f4-95c5-5fc34e70c96b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:38.443098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-64b54b14-bbfc-43f4-95c5-5fc34e70c96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:38.456067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 666/1348] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:38.520657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce62b8-209c-42f7-8dc9-f4ea424ed879 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:38.534601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce62b8-209c-42f7-8dc9-f4ea424ed879 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:38.543418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf38ee-c409-4e98-8f6e-f050188f2e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:38.544527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf38ee-c409-4e98-8f6e-f050188f2e79 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.545051 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf38ee-c409-4e98-8f6e-f050188f2e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.545549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf38ee-c409-4e98-8f6e-f050188f2e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.565644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf38ee-c409-4e98-8f6e-f050188f2e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:38.568370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf38ee-c409-4e98-8f6e-f050188f2e79 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:38.586855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 683/1349] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:45.692329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262eb59-0d35-4b0f-a9be-963282350ef4 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:45.692791 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262eb59-0d35-4b0f-a9be-963282350ef4 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:45.692937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262eb59-0d35-4b0f-a9be-963282350ef4 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:45.694338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 667/1350] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 16:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:45.700323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcde2ef-3f6d-4696-a26b-79e5ee5f250c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:45.700982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcde2ef-3f6d-4696-a26b-79e5ee5f250c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:45.700982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcde2ef-3f6d-4696-a26b-79e5ee5f250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:45.805738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-adcde2ef-3f6d-4696-a26b-79e5ee5f250c None None] MFA Rules not processed for user `bae184afff284dcaa228859902e92191`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:45.806899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-adcde2ef-3f6d-4696-a26b-79e5ee5f250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:45.975413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 684/1351] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 16:55:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:48.433365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=26 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:51.001960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56c5d-e833-419d-b38d-86146a23e92a None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:51.002763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56c5d-e833-419d-b38d-86146a23e92a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:51.002763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56c5d-e833-419d-b38d-86146a23e92a None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:51.004511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 668/1352] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 16:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:51.009804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c28a1-70c6-440e-b28e-b49bc748da00 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:51.010392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c28a1-70c6-440e-b28e-b49bc748da00 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:51.010635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c28a1-70c6-440e-b28e-b49bc748da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:51.036019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-636c28a1-70c6-440e-b28e-b49bc748da00 None None] MFA Rules not processed for user `bae184afff284dcaa228859902e92191`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:51.038411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-636c28a1-70c6-440e-b28e-b49bc748da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:51.054470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 685/1353] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 16:55:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:52.719728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8dd8c-4169-4433-999e-937f5abdf3f6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:52.720289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8dd8c-4169-4433-999e-937f5abdf3f6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:52.720938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8dd8c-4169-4433-999e-937f5abdf3f6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:52.723271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 669/1354] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 16:55:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:52.729008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73d13-7936-4a0f-804b-0da08185d088 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:52.729903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73d13-7936-4a0f-804b-0da08185d088 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:52.730195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73d13-7936-4a0f-804b-0da08185d088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:52.749786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c2a73d13-7936-4a0f-804b-0da08185d088 None None] MFA Rules not processed for user `bae184afff284dcaa228859902e92191`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:52.752532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c2a73d13-7936-4a0f-804b-0da08185d088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:52.766436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 686/1355] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 16:55:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:57.070498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41feeff7-6fb0-47c7-b000-c7d40d131320 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:57.070498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41feeff7-6fb0-47c7-b000-c7d40d131320 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:57.070498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41feeff7-6fb0-47c7-b000-c7d40d131320 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:57.071441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 670/1356] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:55:57.076622 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0a63-9fca-4e2c-a238-4d9486019c38 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:57.077494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0a63-9fca-4e2c-a238-4d9486019c38 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:57.077917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0a63-9fca-4e2c-a238-4d9486019c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:57.087269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:57.111043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-fbfa0a63-9fca-4e2c-a238-4d9486019c38 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:57.114083 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-fbfa0a63-9fca-4e2c-a238-4d9486019c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:57.129367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 687/1357] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:57.200700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9cb75-7f0d-4668-86ab-19f3a087e933 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:57.201244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9cb75-7f0d-4668-86ab-19f3a087e933 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:57.201683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9cb75-7f0d-4668-86ab-19f3a087e933 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:57.207515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 671/1358] 10.222.0.93 () {54 vars in 961 bytes} [Thu May 26 16:55:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:55:57.223592 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea576f1-1ab3-44c7-b927-1c20fc4df4c0 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:57.224511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea576f1-1ab3-44c7-b927-1c20fc4df4c0 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:57.225256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea576f1-1ab3-44c7-b927-1c20fc4df4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:57.320204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-8ea576f1-1ab3-44c7-b927-1c20fc4df4c0 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:57.322507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8ea576f1-1ab3-44c7-b927-1c20fc4df4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:57.462056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 688/1359] 10.222.0.93 () {58 vars in 1058 bytes} [Thu May 26 16:55:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:57.474188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9cb75-7f0d-4668-86ab-19f3a087e933 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:57.495511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9cb75-7f0d-4668-86ab-19f3a087e933 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:57.501462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ceb0d-8d34-4346-8149-5eb5abc0b19a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:57.502110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ceb0d-8d34-4346-8149-5eb5abc0b19a service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:57.502690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ceb0d-8d34-4346-8149-5eb5abc0b19a service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:57.502977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ceb0d-8d34-4346-8149-5eb5abc0b19a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:57.513665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ceb0d-8d34-4346-8149-5eb5abc0b19a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:57.517118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ceb0d-8d34-4346-8149-5eb5abc0b19a service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:57.530979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 672/1360] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:00.397076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2516-4191-4aaf-a0f2-ba2d887218c5 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.397872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2516-4191-4aaf-a0f2-ba2d887218c5 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.398348 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2516-4191-4aaf-a0f2-ba2d887218c5 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.401360 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 689/1361] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:00.411707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2980f1f-9b56-4f46-b059-81e6703df3e6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.412592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2980f1f-9b56-4f46-b059-81e6703df3e6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.413006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2980f1f-9b56-4f46-b059-81e6703df3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.435976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a2980f1f-9b56-4f46-b059-81e6703df3e6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:00.438251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a2980f1f-9b56-4f46-b059-81e6703df3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:00.447649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 673/1362] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:00.494029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2516-4191-4aaf-a0f2-ba2d887218c5 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:00.509325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2516-4191-4aaf-a0f2-ba2d887218c5 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:00.515006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8465c-e0b3-469e-9f31-680f428b6788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:00.516223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8465c-e0b3-469e-9f31-680f428b6788 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.516515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8465c-e0b3-469e-9f31-680f428b6788 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.516796 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8465c-e0b3-469e-9f31-680f428b6788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.527933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8465c-e0b3-469e-9f31-680f428b6788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:00.530005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8465c-e0b3-469e-9f31-680f428b6788 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:00.543920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 690/1363] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:56:03.511093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be8c3-ff37-4219-89ce-68e530d6cc7d None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:03.512094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be8c3-ff37-4219-89ce-68e530d6cc7d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:03.512094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be8c3-ff37-4219-89ce-68e530d6cc7d None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:03.513085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 674/1364] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:56:03.521214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ca7f1-e818-489e-b3e2-747ec6eb664b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:03.521767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ca7f1-e818-489e-b3e2-747ec6eb664b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:03.521767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ca7f1-e818-489e-b3e2-747ec6eb664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:03.568755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-359ca7f1-e818-489e-b3e2-747ec6eb664b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:03.575647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-359ca7f1-e818-489e-b3e2-747ec6eb664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:03.586948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 691/1365] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:03.666964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c9e4-4f61-4044-85dd-5702e94d3780 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:03.667439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c9e4-4f61-4044-85dd-5702e94d3780 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:03.668212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c9e4-4f61-4044-85dd-5702e94d3780 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:03.670927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 675/1366] 10.222.0.93 () {54 vars in 961 bytes} [Thu May 26 16:56:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:03.677917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3c434-382e-4ed0-bffa-15b4312b0ce1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:03.678263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3c434-382e-4ed0-bffa-15b4312b0ce1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:03.678480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3c434-382e-4ed0-bffa-15b4312b0ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:03.710864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-6ad3c434-382e-4ed0-bffa-15b4312b0ce1 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:03.713117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6ad3c434-382e-4ed0-bffa-15b4312b0ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:03.730972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 692/1367] 10.222.0.93 () {58 vars in 1058 bytes} [Thu May 26 16:56:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:56:03.746898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c9e4-4f61-4044-85dd-5702e94d3780 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:03.773428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c9e4-4f61-4044-85dd-5702e94d3780 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:03.783481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce5d93-836b-43d9-9b93-78a1e9a74ddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:03.784646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce5d93-836b-43d9-9b93-78a1e9a74ddd service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:03.785142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce5d93-836b-43d9-9b93-78a1e9a74ddd service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:03.785632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce5d93-836b-43d9-9b93-78a1e9a74ddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:03.797578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce5d93-836b-43d9-9b93-78a1e9a74ddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:03.799330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce5d93-836b-43d9-9b93-78a1e9a74ddd service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:03.817293 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 676/1368] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:06.612441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd98d9-f5d7-49c8-8698-a0c2cab6f633 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:06.613257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd98d9-f5d7-49c8-8698-a0c2cab6f633 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:06.613257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd98d9-f5d7-49c8-8698-a0c2cab6f633 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:06.614840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 693/1369] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:56:06.620731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32365c-2a94-415c-855d-73534424ebb2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:06.621318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32365c-2a94-415c-855d-73534424ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:06.621318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32365c-2a94-415c-855d-73534424ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:06.641336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-fd32365c-2a94-415c-855d-73534424ebb2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:06.642561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fd32365c-2a94-415c-855d-73534424ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:06.651540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 677/1370] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:06.701728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd98d9-f5d7-49c8-8698-a0c2cab6f633 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:06.719157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd98d9-f5d7-49c8-8698-a0c2cab6f633 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:06.725372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195644a3-6d5f-47cc-a38d-f4f6f0e1a826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:06.726115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195644a3-6d5f-47cc-a38d-f4f6f0e1a826 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:06.727439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195644a3-6d5f-47cc-a38d-f4f6f0e1a826 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:06.727439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195644a3-6d5f-47cc-a38d-f4f6f0e1a826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:06.737798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195644a3-6d5f-47cc-a38d-f4f6f0e1a826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:06.739466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195644a3-6d5f-47cc-a38d-f4f6f0e1a826 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:06.751742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 694/1371] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:08.017289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5f5d5-6194-48aa-934b-20595d1e08f1 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:08.017881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5f5d5-6194-48aa-934b-20595d1e08f1 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:08.018192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5f5d5-6194-48aa-934b-20595d1e08f1 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:08.023956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 678/1372] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:08.030664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85901b3-f68d-4cce-aefd-2132e323697e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:08.031513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85901b3-f68d-4cce-aefd-2132e323697e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:08.031730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85901b3-f68d-4cce-aefd-2132e323697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:08.065246 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d85901b3-f68d-4cce-aefd-2132e323697e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:08.067477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d85901b3-f68d-4cce-aefd-2132e323697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:08.082575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 695/1373] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:08.505226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877bd59-4b65-4358-a4cc-967e371d44a7 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:08.505881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877bd59-4b65-4358-a4cc-967e371d44a7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:08.506506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877bd59-4b65-4358-a4cc-967e371d44a7 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:08.510033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 679/1374] 10.222.0.93 () {54 vars in 963 bytes} [Thu May 26 16:56:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:08.519384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb25a-d3f5-450f-9414-20ef33090e46 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:08.520079 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb25a-d3f5-450f-9414-20ef33090e46 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:08.520578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb25a-d3f5-450f-9414-20ef33090e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:08.598812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-675fb25a-d3f5-450f-9414-20ef33090e46 None None] MFA Rules not processed for user `68cb539d18194ce6a0ad60f206699d78`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:08.600172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-675fb25a-d3f5-450f-9414-20ef33090e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:08.648372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:08.700813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 696/1375] 10.222.0.93 () {58 vars in 1060 bytes} [Thu May 26 16:56:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:08.720018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877bd59-4b65-4358-a4cc-967e371d44a7 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:08.733038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877bd59-4b65-4358-a4cc-967e371d44a7 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:08.738243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f422965-79f5-4ec0-bffa-6df1e9ba198e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:08.739062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f422965-79f5-4ec0-bffa-6df1e9ba198e service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:08.739456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f422965-79f5-4ec0-bffa-6df1e9ba198e service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:08.740096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f422965-79f5-4ec0-bffa-6df1e9ba198e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:08.754302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f422965-79f5-4ec0-bffa-6df1e9ba198e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:08.756315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f422965-79f5-4ec0-bffa-6df1e9ba198e service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:08.771618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 680/1376] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:09.860467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e429565-4c21-4859-a7e1-56cc3ccc6e32 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:09.861267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e429565-4c21-4859-a7e1-56cc3ccc6e32 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:09.861267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e429565-4c21-4859-a7e1-56cc3ccc6e32 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:09.862368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 697/1377] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:56:09.872154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaba16-0d42-4718-a9f4-16c8f098c8c8 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:09.872967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaba16-0d42-4718-a9f4-16c8f098c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:09.873154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaba16-0d42-4718-a9f4-16c8f098c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:09.897763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0fcaba16-0d42-4718-a9f4-16c8f098c8c8 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:09.899183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0fcaba16-0d42-4718-a9f4-16c8f098c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:09.910446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 681/1378] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:09.965426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e429565-4c21-4859-a7e1-56cc3ccc6e32 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:09.987093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e429565-4c21-4859-a7e1-56cc3ccc6e32 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:09.993479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9b68c-7ddc-4141-b3fe-107db0b40548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:09.994178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b68c-7ddc-4141-b3fe-107db0b40548 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:09.994457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b68c-7ddc-4141-b3fe-107db0b40548 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:09.994728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b68c-7ddc-4141-b3fe-107db0b40548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:10.004769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9b68c-7ddc-4141-b3fe-107db0b40548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:10.006455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9b68c-7ddc-4141-b3fe-107db0b40548 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:10.019021 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 698/1379] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:13.034098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1963c3-015b-41f4-97f7-1f2c11550378 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:13.035033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1963c3-015b-41f4-97f7-1f2c11550378 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:13.035466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1963c3-015b-41f4-97f7-1f2c11550378 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:13.037276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 682/1380] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:56:13.043879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fcad8-1a11-4e48-b8d1-3eaedb448d88 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:13.044409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fcad8-1a11-4e48-b8d1-3eaedb448d88 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:13.044498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fcad8-1a11-4e48-b8d1-3eaedb448d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:13.070469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-737fcad8-1a11-4e48-b8d1-3eaedb448d88 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:13.071669 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-737fcad8-1a11-4e48-b8d1-3eaedb448d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:13.093964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 699/1381] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:13.132097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1963c3-015b-41f4-97f7-1f2c11550378 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:13.149243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1963c3-015b-41f4-97f7-1f2c11550378 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:13.156470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9b19a-8ac7-4e06-82cc-a2e595a17cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:13.156470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9b19a-8ac7-4e06-82cc-a2e595a17cbc service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:13.156926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9b19a-8ac7-4e06-82cc-a2e595a17cbc service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:13.157114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9b19a-8ac7-4e06-82cc-a2e595a17cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:13.168881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9b19a-8ac7-4e06-82cc-a2e595a17cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:13.170509 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9b19a-8ac7-4e06-82cc-a2e595a17cbc service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:13.182279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 683/1382] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:16.355936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cbe22-a9a0-4330-ba23-03cdf5389254 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:16.356768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cbe22-a9a0-4330-ba23-03cdf5389254 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:16.356959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cbe22-a9a0-4330-ba23-03cdf5389254 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:16.359861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 700/1383] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:16.369860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ed13e-6d1c-4f25-9d52-73f2b8c6c1fd None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:16.370675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ed13e-6d1c-4f25-9d52-73f2b8c6c1fd None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:16.370964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ed13e-6d1c-4f25-9d52-73f2b8c6c1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:16.404925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-982ed13e-6d1c-4f25-9d52-73f2b8c6c1fd None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:16.407483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-982ed13e-6d1c-4f25-9d52-73f2b8c6c1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:16.424552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 684/1384] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:16.488431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cbe22-a9a0-4330-ba23-03cdf5389254 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:16.517448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cbe22-a9a0-4330-ba23-03cdf5389254 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:16.528217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b811-089a-4782-8bae-0040df76184f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:16.529795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b811-089a-4782-8bae-0040df76184f service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:16.530482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b811-089a-4782-8bae-0040df76184f service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:16.531132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b811-089a-4782-8bae-0040df76184f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:16.548940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371b811-089a-4782-8bae-0040df76184f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:16.552388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371b811-089a-4782-8bae-0040df76184f service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:16.573434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 701/1385] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:19.632343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7db6ff-3050-4a85-8c6a-c3932e8ac924 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:19.633338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7db6ff-3050-4a85-8c6a-c3932e8ac924 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:19.633338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7db6ff-3050-4a85-8c6a-c3932e8ac924 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:19.634738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 685/1386] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:19.644147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4d63-5e3c-4b59-9693-7e246a1a458f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:19.644950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4d63-5e3c-4b59-9693-7e246a1a458f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:19.644950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4d63-5e3c-4b59-9693-7e246a1a458f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:19.674295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-787e4d63-5e3c-4b59-9693-7e246a1a458f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:19.676514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-787e4d63-5e3c-4b59-9693-7e246a1a458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:19.687670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 702/1387] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:56:19.792664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7db6ff-3050-4a85-8c6a-c3932e8ac924 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:19.804368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=37 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:19.824456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7db6ff-3050-4a85-8c6a-c3932e8ac924 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:19.838145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b46e2-9e3d-408a-8a4b-3e656f11ae86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:19.838145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b46e2-9e3d-408a-8a4b-3e656f11ae86 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:19.838145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b46e2-9e3d-408a-8a4b-3e656f11ae86 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:19.838145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b46e2-9e3d-408a-8a4b-3e656f11ae86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:19.848380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b46e2-9e3d-408a-8a4b-3e656f11ae86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:19.849878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b46e2-9e3d-408a-8a4b-3e656f11ae86 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:19.866943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 686/1388] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:22.962668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042e733-8182-486e-9f67-33aded39c069 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:22.963297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042e733-8182-486e-9f67-33aded39c069 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:22.963482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042e733-8182-486e-9f67-33aded39c069 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:22.965999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 703/1389] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:22.975918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d820a-667e-43a4-a577-2de4a13b0399 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:22.976805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d820a-667e-43a4-a577-2de4a13b0399 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:22.976805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d820a-667e-43a4-a577-2de4a13b0399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:23.004896 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b05d820a-667e-43a4-a577-2de4a13b0399 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:23.006406 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b05d820a-667e-43a4-a577-2de4a13b0399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:23.025141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 687/1390] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:56:23.084141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042e733-8182-486e-9f67-33aded39c069 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:23.104924 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042e733-8182-486e-9f67-33aded39c069 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:23.112934 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b6d82-927b-42ce-a45f-0dcf535488ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:23.114415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b6d82-927b-42ce-a45f-0dcf535488ba service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:23.114613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b6d82-927b-42ce-a45f-0dcf535488ba service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:23.115158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b6d82-927b-42ce-a45f-0dcf535488ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:23.138795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b6d82-927b-42ce-a45f-0dcf535488ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:23.143669 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b6d82-927b-42ce-a45f-0dcf535488ba service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:23.168570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 704/1391] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:26.167277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd157c-c197-4cef-bb59-a4bf3b018e40 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:26.168021 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd157c-c197-4cef-bb59-a4bf3b018e40 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:26.168189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd157c-c197-4cef-bb59-a4bf3b018e40 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:26.171458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 688/1392] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:26.180292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602edb3f-6aac-4503-99ab-5fb03740f644 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:26.181140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602edb3f-6aac-4503-99ab-5fb03740f644 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:26.181319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602edb3f-6aac-4503-99ab-5fb03740f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:26.203137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-602edb3f-6aac-4503-99ab-5fb03740f644 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:26.204695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-602edb3f-6aac-4503-99ab-5fb03740f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:26.214923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 705/1393] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:26.269695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd157c-c197-4cef-bb59-a4bf3b018e40 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:26.296399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd157c-c197-4cef-bb59-a4bf3b018e40 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:26.306132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c800a-3955-4a0e-b3a0-d57f14fdf7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:26.307325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c800a-3955-4a0e-b3a0-d57f14fdf7ce service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:26.307891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c800a-3955-4a0e-b3a0-d57f14fdf7ce service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:26.308375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c800a-3955-4a0e-b3a0-d57f14fdf7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:26.324620 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c800a-3955-4a0e-b3a0-d57f14fdf7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:26.327602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c800a-3955-4a0e-b3a0-d57f14fdf7ce service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:26.347775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 689/1394] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:56:28.315892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e7719-8992-4703-811d-5df703dc6365 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:28.316791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e7719-8992-4703-811d-5df703dc6365 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:28.316791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e7719-8992-4703-811d-5df703dc6365 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:28.318185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 706/1395] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:28.325440 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05b8a2-c1d1-4ef6-a48f-0bcc4f7d5c81 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:28.336378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05b8a2-c1d1-4ef6-a48f-0bcc4f7d5c81 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:28.336378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05b8a2-c1d1-4ef6-a48f-0bcc4f7d5c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:28.348438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ff05b8a2-c1d1-4ef6-a48f-0bcc4f7d5c81 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:28.349877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ff05b8a2-c1d1-4ef6-a48f-0bcc4f7d5c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:28.359685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 690/1396] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:56:28.435331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554ede2-7858-400b-92e4-c09d2709c4c9 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:28.435871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554ede2-7858-400b-92e4-c09d2709c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:28.436388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554ede2-7858-400b-92e4-c09d2709c4c9 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:28.438964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 707/1397] 10.222.0.93 () {54 vars in 962 bytes} [Thu May 26 16:56:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:28.445497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57999b8-d059-4d20-8998-41f1e1545546 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:28.445861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57999b8-d059-4d20-8998-41f1e1545546 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:28.446242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57999b8-d059-4d20-8998-41f1e1545546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:28.516303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d57999b8-d059-4d20-8998-41f1e1545546 None None] MFA Rules not processed for user `4145a3bf87a94f4e9d39e16dc483595b`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:28.517690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d57999b8-d059-4d20-8998-41f1e1545546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:28.598477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 691/1398] 10.222.0.93 () {58 vars in 1059 bytes} [Thu May 26 16:56:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:28.608807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554ede2-7858-400b-92e4-c09d2709c4c9 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:28.628469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554ede2-7858-400b-92e4-c09d2709c4c9 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:28.635130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25bbe5-e70d-4a2f-9bc1-436a6956fa7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4145a3bf87a94f4e9d39e16dc483595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:28.636518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25bbe5-e70d-4a2f-9bc1-436a6956fa7d service glance] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:28.637033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25bbe5-e70d-4a2f-9bc1-436a6956fa7d service glance] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:28.637532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25bbe5-e70d-4a2f-9bc1-436a6956fa7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:28.655061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25bbe5-e70d-4a2f-9bc1-436a6956fa7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:28.657952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25bbe5-e70d-4a2f-9bc1-436a6956fa7d service glance] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:28.681933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 708/1399] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:29.779552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642100b1-c30a-4ff8-9240-83d18179e843 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:29.780892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642100b1-c30a-4ff8-9240-83d18179e843 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:29.781065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642100b1-c30a-4ff8-9240-83d18179e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:29.830263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d16e7b-70b7-4e7e-ad90-e7b30758bbdf None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:29.830824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d16e7b-70b7-4e7e-ad90-e7b30758bbdf None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:29.830958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d16e7b-70b7-4e7e-ad90-e7b30758bbdf None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:29.833191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 709/1400] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:56:29.840223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54333-16f4-40df-8ed4-36f2e2bc2e7f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:29.840683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54333-16f4-40df-8ed4-36f2e2bc2e7f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:29.841127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54333-16f4-40df-8ed4-36f2e2bc2e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:29.867674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-6de54333-16f4-40df-8ed4-36f2e2bc2e7f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:29.870202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6de54333-16f4-40df-8ed4-36f2e2bc2e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:29.873781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-642100b1-c30a-4ff8-9240-83d18179e843 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:29.875845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-642100b1-c30a-4ff8-9240-83d18179e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:29.884525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 710/1401] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:56:29.934476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54333-16f4-40df-8ed4-36f2e2bc2e7f None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:29.954015 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54333-16f4-40df-8ed4-36f2e2bc2e7f None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:29.960022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 692/1402] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:29.960399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493371f4-a139-421b-9463-c66dd1c857a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:29.960922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493371f4-a139-421b-9463-c66dd1c857a1 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:29.961208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493371f4-a139-421b-9463-c66dd1c857a1 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:29.961553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493371f4-a139-421b-9463-c66dd1c857a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:29.972187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493371f4-a139-421b-9463-c66dd1c857a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:29.974059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493371f4-a139-421b-9463-c66dd1c857a1 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:29.987975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 711/1403] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:30.023886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58305304-44da-4920-ac1b-b2c9b35edbfe None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:30.024320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58305304-44da-4920-ac1b-b2c9b35edbfe None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:30.024606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58305304-44da-4920-ac1b-b2c9b35edbfe None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:30.026070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 693/1404] 10.222.0.93 () {54 vars in 942 bytes} [Thu May 26 16:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:30.035101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c51731-7101-4a06-ad4d-959d01188654 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:30.036904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c51731-7101-4a06-ad4d-959d01188654 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:30.036904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c51731-7101-4a06-ad4d-959d01188654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:30.098544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-99c51731-7101-4a06-ad4d-959d01188654 None None] MFA Rules not processed for user `45cfc967b8634e60b3ddfe4168a748b4`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:30.099979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-99c51731-7101-4a06-ad4d-959d01188654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:30.235317 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 712/1405] 10.222.0.93 () {58 vars in 1039 bytes} [Thu May 26 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:30.250789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58305304-44da-4920-ac1b-b2c9b35edbfe None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:30.269528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58305304-44da-4920-ac1b-b2c9b35edbfe None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:30.278044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6e01d-82ab-4ede-9ec5-c362033b44f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:30.278724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e01d-82ab-4ede-9ec5-c362033b44f7 service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:30.279006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e01d-82ab-4ede-9ec5-c362033b44f7 service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:30.279281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e01d-82ab-4ede-9ec5-c362033b44f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:30.289964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6e01d-82ab-4ede-9ec5-c362033b44f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:30.291775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6e01d-82ab-4ede-9ec5-c362033b44f7 service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:30.296075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:30.302436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 694/1406] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 16:56:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:56:32.861959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64177080-3477-4d48-96c7-28ef7c972579 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:32.862773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64177080-3477-4d48-96c7-28ef7c972579 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:32.862773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64177080-3477-4d48-96c7-28ef7c972579 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:32.868100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 713/1407] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:56:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:56:32.870345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aa01e-74de-4aa6-9411-9a7325c7879b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:32.871146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aa01e-74de-4aa6-9411-9a7325c7879b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:32.871873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aa01e-74de-4aa6-9411-9a7325c7879b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:32.914779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a97aa01e-74de-4aa6-9411-9a7325c7879b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:32.917076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a97aa01e-74de-4aa6-9411-9a7325c7879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:32.931666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 695/1408] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:33.002560 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64177080-3477-4d48-96c7-28ef7c972579 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:33.027775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64177080-3477-4d48-96c7-28ef7c972579 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:33.036109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f4162-d08d-4a63-a45c-ae410a28dad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:33.037420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4162-d08d-4a63-a45c-ae410a28dad5 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:33.037947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4162-d08d-4a63-a45c-ae410a28dad5 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:33.038428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4162-d08d-4a63-a45c-ae410a28dad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:33.049725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:33.053831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f4162-d08d-4a63-a45c-ae410a28dad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:33.057007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f4162-d08d-4a63-a45c-ae410a28dad5 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:33.078297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 714/1409] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:42.907263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:43.107893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:56.380011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e617c-85f1-4928-9ae6-fa18efbaafb6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:56.380660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e617c-85f1-4928-9ae6-fa18efbaafb6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:56.380660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e617c-85f1-4928-9ae6-fa18efbaafb6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:56.382018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 696/1410] 10.222.0.93 () {54 vars in 918 bytes} [Thu May 26 16:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:56.387145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aecf38-7f97-4668-8893-fa302814e77e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:56.388258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aecf38-7f97-4668-8893-fa302814e77e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:56.388378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aecf38-7f97-4668-8893-fa302814e77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:56.407202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b0aecf38-7f97-4668-8893-fa302814e77e None None] MFA Rules not processed for user `bae184afff284dcaa228859902e92191`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:56.408465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b0aecf38-7f97-4668-8893-fa302814e77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:56.417334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 715/1411] 10.222.0.93 () {58 vars in 1015 bytes} [Thu May 26 16:56:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:56.431956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12aee6-7ff2-47eb-9e29-bc978e6fe8ae None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:56.432272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12aee6-7ff2-47eb-9e29-bc978e6fe8ae None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:56.432508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12aee6-7ff2-47eb-9e29-bc978e6fe8ae None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:56.434033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 697/1412] 10.222.0.93 () {54 vars in 918 bytes} [Thu May 26 16:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:56.439493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b79f5-27fb-433f-881c-b572cfc01f38 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:56.439821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b79f5-27fb-433f-881c-b572cfc01f38 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:56.440101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b79f5-27fb-433f-881c-b572cfc01f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:56.458771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-827b79f5-27fb-433f-881c-b572cfc01f38 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:56.460013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-827b79f5-27fb-433f-881c-b572cfc01f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:56.470084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 716/1413] 10.222.0.93 () {58 vars in 1015 bytes} [Thu May 26 16:56:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:59.445170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1dab2-c208-41c6-81fe-a2aa0c932b0b None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:59.446025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1dab2-c208-41c6-81fe-a2aa0c932b0b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:59.446025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1dab2-c208-41c6-81fe-a2aa0c932b0b None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:59.447353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:59.454263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177ee7f-cb62-4fca-8e81-11c3d578496f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:59.455185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177ee7f-cb62-4fca-8e81-11c3d578496f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:59.455185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177ee7f-cb62-4fca-8e81-11c3d578496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:59.476965 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e177ee7f-cb62-4fca-8e81-11c3d578496f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:59.478183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e177ee7f-cb62-4fca-8e81-11c3d578496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:59.489436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:56:59.534385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1dab2-c208-41c6-81fe-a2aa0c932b0b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:59.549904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1dab2-c208-41c6-81fe-a2aa0c932b0b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:59.555460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cafb4-9ac6-47dd-83cf-705c8ee27bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:59.556154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cafb4-9ac6-47dd-83cf-705c8ee27bfa service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:59.556435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cafb4-9ac6-47dd-83cf-705c8ee27bfa service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:59.556710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cafb4-9ac6-47dd-83cf-705c8ee27bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:59.566551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cafb4-9ac6-47dd-83cf-705c8ee27bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:59.571609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cafb4-9ac6-47dd-83cf-705c8ee27bfa service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:59.579997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 699/1416] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:00.669985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc388-4884-406c-a496-c6d313a0bff2 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:00.670817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc388-4884-406c-a496-c6d313a0bff2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:00.671059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc388-4884-406c-a496-c6d313a0bff2 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:00.673826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:57:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:57:00.681836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37242c-6723-4fab-bc19-97a544196686 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:00.682927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37242c-6723-4fab-bc19-97a544196686 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:00.682927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37242c-6723-4fab-bc19-97a544196686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:00.707746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-cd37242c-6723-4fab-bc19-97a544196686 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:00.709165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-cd37242c-6723-4fab-bc19-97a544196686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:00.719675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:00.928714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc388-4884-406c-a496-c6d313a0bff2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:00.953747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc388-4884-406c-a496-c6d313a0bff2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:00.963724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad162a4-038e-4f72-837b-26b412d41d5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:00.965068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad162a4-038e-4f72-837b-26b412d41d5f service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:00.966001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad162a4-038e-4f72-837b-26b412d41d5f service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:00.966490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad162a4-038e-4f72-837b-26b412d41d5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:00.983271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad162a4-038e-4f72-837b-26b412d41d5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:00.986010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad162a4-038e-4f72-837b-26b412d41d5f service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:01.005234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 719/1419] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:02.344702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951e6a-1591-4732-b113-3c42a9970356 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:02.345289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951e6a-1591-4732-b113-3c42a9970356 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:02.345680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951e6a-1591-4732-b113-3c42a9970356 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:02.348348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:57:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:02.357291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed188e51-ca9c-49da-b245-aa47d2aab4c6 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:02.357884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed188e51-ca9c-49da-b245-aa47d2aab4c6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:02.358283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed188e51-ca9c-49da-b245-aa47d2aab4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:02.390268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-ed188e51-ca9c-49da-b245-aa47d2aab4c6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:02.392444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ed188e51-ca9c-49da-b245-aa47d2aab4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:02.406388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:02.687192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951e6a-1591-4732-b113-3c42a9970356 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:02.711812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951e6a-1591-4732-b113-3c42a9970356 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:02.724941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f568-ec11-49ba-81eb-744b060b9871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:02.725607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f568-ec11-49ba-81eb-744b060b9871 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:02.725886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f568-ec11-49ba-81eb-744b060b9871 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:02.726164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f568-ec11-49ba-81eb-744b060b9871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:02.737719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096f568-ec11-49ba-81eb-744b060b9871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:02.739384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096f568-ec11-49ba-81eb-744b060b9871 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:02.751222 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 702/1422] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:03.753449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74373c-539b-4b1b-8931-85b5e50635c9 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:03.753997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74373c-539b-4b1b-8931-85b5e50635c9 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:03.754235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74373c-539b-4b1b-8931-85b5e50635c9 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:03.755983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:03.761640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136862d6-188e-4e42-803c-aff7b1ed23e2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:03.763013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136862d6-188e-4e42-803c-aff7b1ed23e2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:03.763013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136862d6-188e-4e42-803c-aff7b1ed23e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:03.783758 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-136862d6-188e-4e42-803c-aff7b1ed23e2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:03.785067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-136862d6-188e-4e42-803c-aff7b1ed23e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:03.794184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:04.048197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74373c-539b-4b1b-8931-85b5e50635c9 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:04.067267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74373c-539b-4b1b-8931-85b5e50635c9 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:04.077228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2133ce-4a58-48cd-a9b7-ac7d6a7b2d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:04.078340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2133ce-4a58-48cd-a9b7-ac7d6a7b2d22 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:04.078887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2133ce-4a58-48cd-a9b7-ac7d6a7b2d22 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:04.079368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2133ce-4a58-48cd-a9b7-ac7d6a7b2d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:04.096760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2133ce-4a58-48cd-a9b7-ac7d6a7b2d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:04.100179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2133ce-4a58-48cd-a9b7-ac7d6a7b2d22 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:04.119469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 722/1425] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:05.122020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbee69-05d8-4518-8774-4cce31e84e88 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:05.122569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbee69-05d8-4518-8774-4cce31e84e88 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:05.122906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbee69-05d8-4518-8774-4cce31e84e88 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:05.125303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:57:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:05.133032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21ef9a-ce32-4395-b71a-3e33ada62d5a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:05.133780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21ef9a-ce32-4395-b71a-3e33ada62d5a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:05.133780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21ef9a-ce32-4395-b71a-3e33ada62d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:05.152254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9b21ef9a-ce32-4395-b71a-3e33ada62d5a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:05.154069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9b21ef9a-ce32-4395-b71a-3e33ada62d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:05.162267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:57:05.316323 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbee69-05d8-4518-8774-4cce31e84e88 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:05.338593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbee69-05d8-4518-8774-4cce31e84e88 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:05.346015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ee71a-d24e-4896-834c-78f9526c5c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:05.346876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee71a-d24e-4896-834c-78f9526c5c04 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:05.347267 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee71a-d24e-4896-834c-78f9526c5c04 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:05.347766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ee71a-d24e-4896-834c-78f9526c5c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:05.357274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ee71a-d24e-4896-834c-78f9526c5c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:05.358891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ee71a-d24e-4896-834c-78f9526c5c04 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:05.369071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 705/1428] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:06.436471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f4af-f70d-4e78-b3c1-4c969a085388 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:06.437469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f4af-f70d-4e78-b3c1-4c969a085388 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:06.437469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f4af-f70d-4e78-b3c1-4c969a085388 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:06.440036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:57:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:06.446292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c461-7e48-4a53-b94c-9d24355dfd5f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:06.447158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c461-7e48-4a53-b94c-9d24355dfd5f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:06.447158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c461-7e48-4a53-b94c-9d24355dfd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:06.468842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d611c461-7e48-4a53-b94c-9d24355dfd5f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:06.470176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d611c461-7e48-4a53-b94c-9d24355dfd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:06.479265 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:06.728684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7f4af-f70d-4e78-b3c1-4c969a085388 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:06.744863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7f4af-f70d-4e78-b3c1-4c969a085388 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:06.750831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bac83-80b9-4f68-a665-b845d7b20231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:06.751489 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bac83-80b9-4f68-a665-b845d7b20231 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:06.751798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bac83-80b9-4f68-a665-b845d7b20231 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:06.752072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bac83-80b9-4f68-a665-b845d7b20231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:06.761724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bac83-80b9-4f68-a665-b845d7b20231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:06.763373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bac83-80b9-4f68-a665-b845d7b20231 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:06.774541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 725/1431] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:07.859852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd797d-b85a-449f-89b3-18db4c3c5f41 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:07.860430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd797d-b85a-449f-89b3-18db4c3c5f41 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:07.860430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd797d-b85a-449f-89b3-18db4c3c5f41 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:07.861949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:07.867905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9763-3a38-4b82-9645-cb7ea4255e5a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:07.868797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9763-3a38-4b82-9645-cb7ea4255e5a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:07.868797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9763-3a38-4b82-9645-cb7ea4255e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:07.889893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9b1b9763-3a38-4b82-9645-cb7ea4255e5a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:07.891104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9b1b9763-3a38-4b82-9645-cb7ea4255e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:07.904801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:08.061517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd797d-b85a-449f-89b3-18db4c3c5f41 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:08.077242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd797d-b85a-449f-89b3-18db4c3c5f41 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:08.082962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d1a1e-9b60-44c0-87c9-c1be6caf8ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:08.083707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d1a1e-9b60-44c0-87c9-c1be6caf8ef2 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:08.084113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d1a1e-9b60-44c0-87c9-c1be6caf8ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:08.084479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d1a1e-9b60-44c0-87c9-c1be6caf8ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:08.094815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d1a1e-9b60-44c0-87c9-c1be6caf8ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:08.096488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d1a1e-9b60-44c0-87c9-c1be6caf8ef2 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:08.107533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 708/1434] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:09.346753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5db5e-e6d8-40e3-ac3e-11fcbecfa009 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:09.347461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5db5e-e6d8-40e3-ac3e-11fcbecfa009 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:09.347461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5db5e-e6d8-40e3-ac3e-11fcbecfa009 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:09.348773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:09.354892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a224e0-4695-49d5-9711-193a783b07de None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:09.356257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a224e0-4695-49d5-9711-193a783b07de None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:09.356257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a224e0-4695-49d5-9711-193a783b07de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:09.376114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-94a224e0-4695-49d5-9711-193a783b07de None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:09.379271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-94a224e0-4695-49d5-9711-193a783b07de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:09.386221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:09.552992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5db5e-e6d8-40e3-ac3e-11fcbecfa009 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:09.569315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5db5e-e6d8-40e3-ac3e-11fcbecfa009 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:09.575113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28969b77-22fb-4f82-ada3-1dbe1a8f263d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:09.575846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28969b77-22fb-4f82-ada3-1dbe1a8f263d service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:09.578396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28969b77-22fb-4f82-ada3-1dbe1a8f263d service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:09.578396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28969b77-22fb-4f82-ada3-1dbe1a8f263d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:09.586257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28969b77-22fb-4f82-ada3-1dbe1a8f263d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:09.587910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28969b77-22fb-4f82-ada3-1dbe1a8f263d service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:09.599826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 728/1437] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:10.674373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcdf91-4e23-4b11-8709-d3708b1641fc None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:10.674950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcdf91-4e23-4b11-8709-d3708b1641fc None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:10.675047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcdf91-4e23-4b11-8709-d3708b1641fc None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:10.677616 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:10.684194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d354378-0123-4fed-8d2f-8372e79a4814 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:10.684756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d354378-0123-4fed-8d2f-8372e79a4814 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:10.684756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d354378-0123-4fed-8d2f-8372e79a4814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:10.705841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1d354378-0123-4fed-8d2f-8372e79a4814 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:10.707202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1d354378-0123-4fed-8d2f-8372e79a4814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:10.717776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:10.880428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcdf91-4e23-4b11-8709-d3708b1641fc None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:10.899835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcdf91-4e23-4b11-8709-d3708b1641fc None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:10.907329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfcadc-27b8-43ab-b332-398df94f5b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:10.908092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfcadc-27b8-43ab-b332-398df94f5b6a service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:10.908454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfcadc-27b8-43ab-b332-398df94f5b6a service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:10.908829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfcadc-27b8-43ab-b332-398df94f5b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:10.920114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfcadc-27b8-43ab-b332-398df94f5b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:10.921950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfcadc-27b8-43ab-b332-398df94f5b6a service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:10.937727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 711/1440] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:13.454795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4007de-5694-48b3-96d7-2064663375c6 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:13.457037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4007de-5694-48b3-96d7-2064663375c6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:13.457037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4007de-5694-48b3-96d7-2064663375c6 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:13.457813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:57:13.467161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508da3f-a6c8-4770-87eb-7a3320cfe7aa None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:13.467829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508da3f-a6c8-4770-87eb-7a3320cfe7aa None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:13.468154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508da3f-a6c8-4770-87eb-7a3320cfe7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:13.492885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b508da3f-a6c8-4770-87eb-7a3320cfe7aa None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:13.494405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b508da3f-a6c8-4770-87eb-7a3320cfe7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:13.505638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:13.550837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4007de-5694-48b3-96d7-2064663375c6 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:13.564443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4007de-5694-48b3-96d7-2064663375c6 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:13.569238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c86770-9c83-4700-af73-f398991f0164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:13.570108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c86770-9c83-4700-af73-f398991f0164 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:13.570517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c86770-9c83-4700-af73-f398991f0164 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:13.570820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c86770-9c83-4700-af73-f398991f0164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:13.583420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c86770-9c83-4700-af73-f398991f0164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:13.585716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c86770-9c83-4700-af73-f398991f0164 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:13.604788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 731/1443] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:16.584959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7754fe-6ffb-4b7b-b693-0ba183771f33 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:16.585866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7754fe-6ffb-4b7b-b693-0ba183771f33 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:16.585866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7754fe-6ffb-4b7b-b693-0ba183771f33 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:16.587306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:16.594068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f12-2992-4626-8094-670c6fc2e7de None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:16.594944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f12-2992-4626-8094-670c6fc2e7de None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:16.595134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f12-2992-4626-8094-670c6fc2e7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:16.615247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-28620f12-2992-4626-8094-670c6fc2e7de None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:16.616371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-28620f12-2992-4626-8094-670c6fc2e7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:16.625486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:16.664646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7754fe-6ffb-4b7b-b693-0ba183771f33 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:16.680461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7754fe-6ffb-4b7b-b693-0ba183771f33 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:16.687610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde295e-2a51-4a2c-9d6c-562304169c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:16.687610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde295e-2a51-4a2c-9d6c-562304169c20 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:16.688301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde295e-2a51-4a2c-9d6c-562304169c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:16.688586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde295e-2a51-4a2c-9d6c-562304169c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:16.705039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde295e-2a51-4a2c-9d6c-562304169c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:16.706582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde295e-2a51-4a2c-9d6c-562304169c20 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:16.719058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 714/1446] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:19.669069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a3b6d-add0-442e-9083-02d90cd1bdef None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:19.669912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a3b6d-add0-442e-9083-02d90cd1bdef None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:19.669912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a3b6d-add0-442e-9083-02d90cd1bdef None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:19.671151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:57:19.677519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92ee5-9515-4e06-9dde-1523f1433b0a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:19.678354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92ee5-9515-4e06-9dde-1523f1433b0a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:19.678354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92ee5-9515-4e06-9dde-1523f1433b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:19.700820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a5b92ee5-9515-4e06-9dde-1523f1433b0a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:19.702898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a5b92ee5-9515-4e06-9dde-1523f1433b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:19.717530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:19.770296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a3b6d-add0-442e-9083-02d90cd1bdef None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:19.785388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a3b6d-add0-442e-9083-02d90cd1bdef None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:19.791111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4caf3d-020b-4b47-838d-75973fef7065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:19.792117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4caf3d-020b-4b47-838d-75973fef7065 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:19.792914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4caf3d-020b-4b47-838d-75973fef7065 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:19.793343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4caf3d-020b-4b47-838d-75973fef7065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:19.808573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4caf3d-020b-4b47-838d-75973fef7065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:19.811111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4caf3d-020b-4b47-838d-75973fef7065 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:19.828354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 734/1449] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:22.645164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1cd6b-1825-4375-800e-3bfe40c3ab25 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:22.645912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1cd6b-1825-4375-800e-3bfe40c3ab25 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:22.645912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1cd6b-1825-4375-800e-3bfe40c3ab25 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:22.647500 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:22.655758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349483c-f2a9-41de-bad8-ceeba31dfa5d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:22.656392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349483c-f2a9-41de-bad8-ceeba31dfa5d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:22.656738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349483c-f2a9-41de-bad8-ceeba31dfa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:22.680670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9349483c-f2a9-41de-bad8-ceeba31dfa5d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:22.687414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9349483c-f2a9-41de-bad8-ceeba31dfa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:22.694853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:22.739640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1cd6b-1825-4375-800e-3bfe40c3ab25 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:22.754573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1cd6b-1825-4375-800e-3bfe40c3ab25 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:22.758372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f39d72-010f-4fb0-b4ce-19a7489c8d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:22.759093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39d72-010f-4fb0-b4ce-19a7489c8d50 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:22.759374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39d72-010f-4fb0-b4ce-19a7489c8d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:22.759672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39d72-010f-4fb0-b4ce-19a7489c8d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:22.770906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f39d72-010f-4fb0-b4ce-19a7489c8d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:22.773267 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f39d72-010f-4fb0-b4ce-19a7489c8d50 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:22.787031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 717/1452] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:25.256121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a19bc3-0d49-4579-8941-b6087868cd39 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:25.256666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a19bc3-0d49-4579-8941-b6087868cd39 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:25.256666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a19bc3-0d49-4579-8941-b6087868cd39 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:25.257988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:25.263829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e62a3-6f82-47d0-b3bc-4d6cc3dc35af None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:25.264352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e62a3-6f82-47d0-b3bc-4d6cc3dc35af None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:25.264459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e62a3-6f82-47d0-b3bc-4d6cc3dc35af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:25.270549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=61 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:25.283458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ee1e62a3-6f82-47d0-b3bc-4d6cc3dc35af None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:25.284701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ee1e62a3-6f82-47d0-b3bc-4d6cc3dc35af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:25.294364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:25.360245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a19bc3-0d49-4579-8941-b6087868cd39 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:25.365687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=64 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:25.373291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a19bc3-0d49-4579-8941-b6087868cd39 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:25.377186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ab15b-9336-4de1-903a-b95f9fbca140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:25.378905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ab15b-9336-4de1-903a-b95f9fbca140 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:25.378905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ab15b-9336-4de1-903a-b95f9fbca140 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:25.378905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ab15b-9336-4de1-903a-b95f9fbca140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:25.389751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ab15b-9336-4de1-903a-b95f9fbca140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:25.391211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ab15b-9336-4de1-903a-b95f9fbca140 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:25.412418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 737/1455] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:27.841706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b240c-34f9-4cdc-ae1d-6f757d18b5b7 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.842282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b240c-34f9-4cdc-ae1d-6f757d18b5b7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.842282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b240c-34f9-4cdc-ae1d-6f757d18b5b7 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.843663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:27.848980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcecab-f184-4f67-a6c5-440c20f56fe2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.849418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcecab-f184-4f67-a6c5-440c20f56fe2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.849538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcecab-f184-4f67-a6c5-440c20f56fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.867870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e6dcecab-f184-4f67-a6c5-440c20f56fe2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:27.869053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e6dcecab-f184-4f67-a6c5-440c20f56fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:27.876837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:27.914446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b240c-34f9-4cdc-ae1d-6f757d18b5b7 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:27.926666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b240c-34f9-4cdc-ae1d-6f757d18b5b7 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:27.932834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d299a-cbc2-449f-aef3-68484b1be60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:27.933538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d299a-cbc2-449f-aef3-68484b1be60a service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.933796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d299a-cbc2-449f-aef3-68484b1be60a service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.934065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d299a-cbc2-449f-aef3-68484b1be60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.946773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d299a-cbc2-449f-aef3-68484b1be60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:27.948962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d299a-cbc2-449f-aef3-68484b1be60a service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:27.961873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 720/1458] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:30.307634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6aec6-4b6e-4347-946c-32f9a8bd1ac3 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:30.308186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6aec6-4b6e-4347-946c-32f9a8bd1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:30.308186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6aec6-4b6e-4347-946c-32f9a8bd1ac3 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:30.309541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:30.315614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc258a-fed0-4a0a-8171-33a64d46176a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:30.316110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc258a-fed0-4a0a-8171-33a64d46176a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:30.316231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc258a-fed0-4a0a-8171-33a64d46176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:30.334612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-9adc258a-fed0-4a0a-8171-33a64d46176a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:30.335837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9adc258a-fed0-4a0a-8171-33a64d46176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:30.344897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:30.381958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6aec6-4b6e-4347-946c-32f9a8bd1ac3 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:30.395897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6aec6-4b6e-4347-946c-32f9a8bd1ac3 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:30.399409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4681d97-2685-4699-8dff-a6fd1eb4850c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:30.400076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4681d97-2685-4699-8dff-a6fd1eb4850c service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:30.400355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4681d97-2685-4699-8dff-a6fd1eb4850c service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:30.400628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4681d97-2685-4699-8dff-a6fd1eb4850c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:30.410988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4681d97-2685-4699-8dff-a6fd1eb4850c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:30.412497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4681d97-2685-4699-8dff-a6fd1eb4850c service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:30.426888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 740/1461] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:32.792114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2709c-9fb2-42dd-843b-4f1b08a65988 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:32.792665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2709c-9fb2-42dd-843b-4f1b08a65988 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:32.792665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2709c-9fb2-42dd-843b-4f1b08a65988 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:32.793971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:32.799736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047165ad-bf91-4f0f-8b78-b474c95a19b7 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:32.800258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047165ad-bf91-4f0f-8b78-b474c95a19b7 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:32.800359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047165ad-bf91-4f0f-8b78-b474c95a19b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:32.819314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-047165ad-bf91-4f0f-8b78-b474c95a19b7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:32.820594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-047165ad-bf91-4f0f-8b78-b474c95a19b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:32.829177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:32.868248 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2709c-9fb2-42dd-843b-4f1b08a65988 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:32.880101 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2709c-9fb2-42dd-843b-4f1b08a65988 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:32.883659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601a3e3-ecaf-4e53-995b-6820d7a478fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:32.884301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601a3e3-ecaf-4e53-995b-6820d7a478fe service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:32.884576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601a3e3-ecaf-4e53-995b-6820d7a478fe service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:32.884847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601a3e3-ecaf-4e53-995b-6820d7a478fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:32.894835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601a3e3-ecaf-4e53-995b-6820d7a478fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:32.896306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601a3e3-ecaf-4e53-995b-6820d7a478fe service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:32.907324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 723/1464] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:35.381043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd19e5-54c6-4178-855b-0179b42db6fd None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:35.381872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd19e5-54c6-4178-855b-0179b42db6fd None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:35.381872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd19e5-54c6-4178-855b-0179b42db6fd None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:35.382991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:35.390618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230677f-a510-4362-81d7-e96064363fd3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:35.391161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230677f-a510-4362-81d7-e96064363fd3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:35.391807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230677f-a510-4362-81d7-e96064363fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:35.423210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-4230677f-a510-4362-81d7-e96064363fd3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:35.428179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4230677f-a510-4362-81d7-e96064363fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:35.449044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:35.497931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd19e5-54c6-4178-855b-0179b42db6fd None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:35.515188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd19e5-54c6-4178-855b-0179b42db6fd None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:35.519517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8f351-a062-45d3-a7c1-4dd55298776f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:35.520363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8f351-a062-45d3-a7c1-4dd55298776f service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:35.520655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8f351-a062-45d3-a7c1-4dd55298776f service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:35.520931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8f351-a062-45d3-a7c1-4dd55298776f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:35.531095 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8f351-a062-45d3-a7c1-4dd55298776f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:35.532601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8f351-a062-45d3-a7c1-4dd55298776f service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:35.544597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 743/1467] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:37.872525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb250ea-86b3-4a58-99ce-6420b4eb6ad9 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:37.873137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb250ea-86b3-4a58-99ce-6420b4eb6ad9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:37.873137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb250ea-86b3-4a58-99ce-6420b4eb6ad9 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:37.874490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:37.881445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0db3e-6bc8-49e4-a1ce-a0907a40eeeb None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:37.882016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0db3e-6bc8-49e4-a1ce-a0907a40eeeb None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:37.882498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0db3e-6bc8-49e4-a1ce-a0907a40eeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:37.905829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-88b0db3e-6bc8-49e4-a1ce-a0907a40eeeb None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:37.907046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-88b0db3e-6bc8-49e4-a1ce-a0907a40eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:37.915069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:37.951768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb250ea-86b3-4a58-99ce-6420b4eb6ad9 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:37.964983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb250ea-86b3-4a58-99ce-6420b4eb6ad9 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:37.968697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b263c9-e41d-4df0-9fe9-bfe57236bb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:37.969551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b263c9-e41d-4df0-9fe9-bfe57236bb3a service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:37.969833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b263c9-e41d-4df0-9fe9-bfe57236bb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:37.970113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b263c9-e41d-4df0-9fe9-bfe57236bb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:37.979820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b263c9-e41d-4df0-9fe9-bfe57236bb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:37.981359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b263c9-e41d-4df0-9fe9-bfe57236bb3a service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:37.991978 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 726/1470] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:47.899967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=26 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:47.987203 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=26 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:12.390282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed230f1-a4f7-4df1-8463-f3954b67d949 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:12.391181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed230f1-a4f7-4df1-8463-f3954b67d949 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:12.391181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed230f1-a4f7-4df1-8463-f3954b67d949 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:12.393654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 745/1471] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:58:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:58:12.399836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ed9a6-b500-48f5-9280-9803f95b97f2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:12.400483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ed9a6-b500-48f5-9280-9803f95b97f2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:12.400483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ed9a6-b500-48f5-9280-9803f95b97f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:12.423820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-500ed9a6-b500-48f5-9280-9803f95b97f2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:12.425072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-500ed9a6-b500-48f5-9280-9803f95b97f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:12.433752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 727/1472] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:12.486719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdec2a-b884-4730-865c-73a27e9896ba None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:12.487119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdec2a-b884-4730-865c-73a27e9896ba None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:12.487283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdec2a-b884-4730-865c-73a27e9896ba None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:12.488826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 746/1473] 10.222.0.93 () {54 vars in 962 bytes} [Thu May 26 16:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:58:12.495333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf984269-1683-4aa4-a1b1-de188936744a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:12.495660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf984269-1683-4aa4-a1b1-de188936744a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:12.495946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf984269-1683-4aa4-a1b1-de188936744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:12.515800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-bf984269-1683-4aa4-a1b1-de188936744a None None] MFA Rules not processed for user `4145a3bf87a94f4e9d39e16dc483595b`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:12.517123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bf984269-1683-4aa4-a1b1-de188936744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:12.525583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 728/1474] 10.222.0.93 () {58 vars in 1059 bytes} [Thu May 26 16:58:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:12.534106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdec2a-b884-4730-865c-73a27e9896ba None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:12.545925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdec2a-b884-4730-865c-73a27e9896ba None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:12.549926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804cb15-9c05-4a58-b3b4-3b343fe4ce78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4145a3bf87a94f4e9d39e16dc483595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:12.550554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804cb15-9c05-4a58-b3b4-3b343fe4ce78 service glance] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:12.550836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804cb15-9c05-4a58-b3b4-3b343fe4ce78 service glance] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:12.551114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804cb15-9c05-4a58-b3b4-3b343fe4ce78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:12.562364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804cb15-9c05-4a58-b3b4-3b343fe4ce78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:12.563908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804cb15-9c05-4a58-b3b4-3b343fe4ce78 service glance] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:12.576893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 747/1475] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:15.026900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a02a1-d67b-420e-844f-c926a8698151 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.027545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a02a1-d67b-420e-844f-c926a8698151 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.027545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a02a1-d67b-420e-844f-c926a8698151 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.028855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 729/1476] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:58:15.034987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec1e7-bbbb-46a9-b0cb-0fb14e11e2e2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.035535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec1e7-bbbb-46a9-b0cb-0fb14e11e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.035668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec1e7-bbbb-46a9-b0cb-0fb14e11e2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.054778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-2ecec1e7-bbbb-46a9-b0cb-0fb14e11e2e2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:15.056543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2ecec1e7-bbbb-46a9-b0cb-0fb14e11e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:15.064898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 748/1477] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:15.092061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a02a1-d67b-420e-844f-c926a8698151 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:15.107771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a02a1-d67b-420e-844f-c926a8698151 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:15.113062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee154d-46bd-40c8-9bcd-a2898561f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:15.114006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee154d-46bd-40c8-9bcd-a2898561f7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:15.114294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee154d-46bd-40c8-9bcd-a2898561f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:15.114576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee154d-46bd-40c8-9bcd-a2898561f7a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:15.115320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee154d-46bd-40c8-9bcd-a2898561f7a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:15.117186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING py.warnings [None req-f6ee154d-46bd-40c8-9bcd-a2898561f7a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:58:15.117186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: warnings.warn(msg) May 26 16:58:15.117186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: May 26 16:58:15.118850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee154d-46bd-40c8-9bcd-a2898561f7a4 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:15.140074 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 730/1478] 10.222.0.93 () {56 vars in 1108 bytes} [Thu May 26 16:58:15 2022] GET /identity/v3/projects => generated 2553 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:17.525197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259804-fa3a-4adc-bf32-7a617b7b8792 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.525820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259804-fa3a-4adc-bf32-7a617b7b8792 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.525820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259804-fa3a-4adc-bf32-7a617b7b8792 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.527087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 749/1479] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:58:17.532905 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fe24f-fce8-42c0-add4-067c5132a357 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.533539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fe24f-fce8-42c0-add4-067c5132a357 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.533539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fe24f-fce8-42c0-add4-067c5132a357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.554040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8e9fe24f-fce8-42c0-add4-067c5132a357 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:17.555293 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8e9fe24f-fce8-42c0-add4-067c5132a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:17.563932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 731/1480] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:17.610142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259804-fa3a-4adc-bf32-7a617b7b8792 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.627610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259804-fa3a-4adc-bf32-7a617b7b8792 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.633805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234d92-d751-4012-9ed5-3b5300085ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.634609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234d92-d751-4012-9ed5-3b5300085ec3 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.634886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234d92-d751-4012-9ed5-3b5300085ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.635158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234d92-d751-4012-9ed5-3b5300085ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.644992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234d92-d751-4012-9ed5-3b5300085ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:17.646656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234d92-d751-4012-9ed5-3b5300085ec3 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.658046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 750/1481] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:20.268581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814f7a2-e93a-4b44-bf1d-18a3983c4cd6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:20.269439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814f7a2-e93a-4b44-bf1d-18a3983c4cd6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:20.269627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814f7a2-e93a-4b44-bf1d-18a3983c4cd6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:20.271329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 732/1482] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:58:20.277481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bf345-dacf-472a-9ea4-145c42f544c5 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:20.278145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bf345-dacf-472a-9ea4-145c42f544c5 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:20.278145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bf345-dacf-472a-9ea4-145c42f544c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:20.298057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-048bf345-dacf-472a-9ea4-145c42f544c5 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:20.299381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-048bf345-dacf-472a-9ea4-145c42f544c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:20.308700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 751/1483] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:20.352822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814f7a2-e93a-4b44-bf1d-18a3983c4cd6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:20.366364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814f7a2-e93a-4b44-bf1d-18a3983c4cd6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:20.371888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49448da8-4afa-4751-bf44-6394175f6cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:20.372554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448da8-4afa-4751-bf44-6394175f6cbe service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:20.372839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448da8-4afa-4751-bf44-6394175f6cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:20.373153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448da8-4afa-4751-bf44-6394175f6cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:20.384271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49448da8-4afa-4751-bf44-6394175f6cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:20.385759 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49448da8-4afa-4751-bf44-6394175f6cbe service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:20.396792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 733/1484] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:22.826456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a633-94a3-427b-8cbb-c146997298bf None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:22.827005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a633-94a3-427b-8cbb-c146997298bf None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:22.827005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a633-94a3-427b-8cbb-c146997298bf None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:22.828323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 752/1485] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:58:22.834151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d2f02-ee37-4f8f-8ed6-70a53d60496d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:22.834718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d2f02-ee37-4f8f-8ed6-70a53d60496d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:22.834718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d2f02-ee37-4f8f-8ed6-70a53d60496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:22.855854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-4c2d2f02-ee37-4f8f-8ed6-70a53d60496d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:22.857141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4c2d2f02-ee37-4f8f-8ed6-70a53d60496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:22.865349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 734/1486] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:22.905053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a633-94a3-427b-8cbb-c146997298bf None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:22.916591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a633-94a3-427b-8cbb-c146997298bf None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:22.920371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e00065-329f-4dc0-9b7d-53de27568eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:22.921038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e00065-329f-4dc0-9b7d-53de27568eea service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:22.921332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e00065-329f-4dc0-9b7d-53de27568eea service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:22.921605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e00065-329f-4dc0-9b7d-53de27568eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:22.932470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e00065-329f-4dc0-9b7d-53de27568eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:22.933933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e00065-329f-4dc0-9b7d-53de27568eea service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:22.946457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 753/1487] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:25.365880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9101e2f-b3b0-4cd9-a92c-404ffa27535f None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:25.366508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9101e2f-b3b0-4cd9-a92c-404ffa27535f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:25.366508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9101e2f-b3b0-4cd9-a92c-404ffa27535f None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:25.368509 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 735/1488] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:58:25.374832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc462797-d4af-4e55-a692-9bd53ff62fa3 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:25.375370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc462797-d4af-4e55-a692-9bd53ff62fa3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:25.375370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc462797-d4af-4e55-a692-9bd53ff62fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:25.394532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-dc462797-d4af-4e55-a692-9bd53ff62fa3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:25.395819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-dc462797-d4af-4e55-a692-9bd53ff62fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:25.406180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 754/1489] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:25.448141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9101e2f-b3b0-4cd9-a92c-404ffa27535f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:25.459523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9101e2f-b3b0-4cd9-a92c-404ffa27535f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:25.464042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da44ba-1daa-4651-a223-98b08688b8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:25.464692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da44ba-1daa-4651-a223-98b08688b8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:25.464967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da44ba-1daa-4651-a223-98b08688b8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:25.465236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da44ba-1daa-4651-a223-98b08688b8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:25.475336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da44ba-1daa-4651-a223-98b08688b8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:25.477410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da44ba-1daa-4651-a223-98b08688b8b1 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:25.487992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 736/1490] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:28.219962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40a6d-9fc7-48d1-ba76-b6c72c036745 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:28.220534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40a6d-9fc7-48d1-ba76-b6c72c036745 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:28.220534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40a6d-9fc7-48d1-ba76-b6c72c036745 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:28.221887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 755/1491] 10.222.0.93 () {54 vars in 926 bytes} [Thu May 26 16:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:58:28.227581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd6be-906f-4ffd-9779-b79ba0d2f128 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:28.228069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd6be-906f-4ffd-9779-b79ba0d2f128 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:28.228177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd6be-906f-4ffd-9779-b79ba0d2f128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:28.245933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-901fd6be-906f-4ffd-9779-b79ba0d2f128 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:28.247131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-901fd6be-906f-4ffd-9779-b79ba0d2f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:28.254930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 737/1492] 10.222.0.93 () {58 vars in 1023 bytes} [Thu May 26 16:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:28.294370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d40a6d-9fc7-48d1-ba76-b6c72c036745 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:28.305749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d40a6d-9fc7-48d1-ba76-b6c72c036745 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:28.309646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6b3ca-f7c3-4b42-9889-554eb0c88b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:28.310311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6b3ca-f7c3-4b42-9889-554eb0c88b0e service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:28.310596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6b3ca-f7c3-4b42-9889-554eb0c88b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:28.310873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6b3ca-f7c3-4b42-9889-554eb0c88b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:28.321526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6b3ca-f7c3-4b42-9889-554eb0c88b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:28.322994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6b3ca-f7c3-4b42-9889-554eb0c88b0e service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:28.334158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 756/1493] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 16:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:38.240721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=33 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:38.329102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=33 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:23.571322 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faff2a-6071-4926-9794-f02414d32366 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:23.572095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faff2a-6071-4926-9794-f02414d32366 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:23.572095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faff2a-6071-4926-9794-f02414d32366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:23.593493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-63faff2a-6071-4926-9794-f02414d32366 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:23.594730 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-63faff2a-6071-4926-9794-f02414d32366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:23.603330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 738/1494] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:23.613419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dcccd-51ec-48bc-93df-acfc04fda143 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:23.614227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dcccd-51ec-48bc-93df-acfc04fda143 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:23.614227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dcccd-51ec-48bc-93df-acfc04fda143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:23.635161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-2f9dcccd-51ec-48bc-93df-acfc04fda143 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:23.636438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2f9dcccd-51ec-48bc-93df-acfc04fda143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:23.645660 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 757/1495] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:23.650556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63faff2a-6071-4926-9794-f02414d32366 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:23.660943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63faff2a-6071-4926-9794-f02414d32366 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:23.666139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:23.666952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:23.667328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:23.667753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:23.668587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:00:23.668988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:23.670132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING py.warnings [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:00:23.670132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: warnings.warn(msg) May 26 17:00:23.670132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: May 26 17:00:23.671641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:23.689137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 739/1496] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:00:23.698779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dcccd-51ec-48bc-93df-acfc04fda143 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:23.709763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dcccd-51ec-48bc-93df-acfc04fda143 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:23.714794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e64e1-9a5d-429f-9de0-74d86be33e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:23.715479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e64e1-9a5d-429f-9de0-74d86be33e5a admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:23.715810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e64e1-9a5d-429f-9de0-74d86be33e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:23.716069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e64e1-9a5d-429f-9de0-74d86be33e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:23.716799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e64e1-9a5d-429f-9de0-74d86be33e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:23.718675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WARNING py.warnings [None req-626e64e1-9a5d-429f-9de0-74d86be33e5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:00:23.718675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: warnings.warn(msg) May 26 17:00:23.718675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: May 26 17:00:23.719975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e64e1-9a5d-429f-9de0-74d86be33e5a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:23.917281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 758/1497] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:00:23 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:23.922354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:23.933766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a8088-3f22-4bae-b975-0c5947a1e7a7 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:23.998675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45828-d894-4662-a71d-7bb27275ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:23.999360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45828-d894-4662-a71d-7bb27275ab47 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:23.999684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45828-d894-4662-a71d-7bb27275ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:23.999966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45828-d894-4662-a71d-7bb27275ab47 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.000694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a45828-d894-4662-a71d-7bb27275ab47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:24.001752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING py.warnings [None req-d6a45828-d894-4662-a71d-7bb27275ab47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:00:24.001752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: warnings.warn(msg) May 26 17:00:24.001752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: May 26 17:00:24.003048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a45828-d894-4662-a71d-7bb27275ab47 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:24.093814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 740/1498] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:00:23 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:00:24.099334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e64e1-9a5d-429f-9de0-74d86be33e5a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:24.111413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e64e1-9a5d-429f-9de0-74d86be33e5a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:24.116415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf293f94-d5ea-450d-8254-d91277cb745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:24.117095 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293f94-d5ea-450d-8254-d91277cb745e admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.117376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293f94-d5ea-450d-8254-d91277cb745e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.117644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293f94-d5ea-450d-8254-d91277cb745e admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.118431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf293f94-d5ea-450d-8254-d91277cb745e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:24.119450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WARNING py.warnings [None req-cf293f94-d5ea-450d-8254-d91277cb745e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:00:24.119450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: warnings.warn(msg) May 26 17:00:24.119450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: May 26 17:00:24.120403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf293f94-d5ea-450d-8254-d91277cb745e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:24.135017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 759/1499] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:24.141297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45828-d894-4662-a71d-7bb27275ab47 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:24.160105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45828-d894-4662-a71d-7bb27275ab47 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:24.168081 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cc8a6-5b40-4b65-acfd-0c435262a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:24.169090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cc8a6-5b40-4b65-acfd-0c435262a4dd admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.169483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cc8a6-5b40-4b65-acfd-0c435262a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.169867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cc8a6-5b40-4b65-acfd-0c435262a4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.171185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cc8a6-5b40-4b65-acfd-0c435262a4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:24.173249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING py.warnings [None req-315cc8a6-5b40-4b65-acfd-0c435262a4dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:00:24.173249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: warnings.warn(msg) May 26 17:00:24.173249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: May 26 17:00:24.174956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cc8a6-5b40-4b65-acfd-0c435262a4dd admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:24.201179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 741/1500] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:24.206729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf293f94-d5ea-450d-8254-d91277cb745e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:24.217542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf293f94-d5ea-450d-8254-d91277cb745e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:24.223877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dc68e-aa2a-4d8c-ac53-836458220c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:24.224905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dc68e-aa2a-4d8c-ac53-836458220c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.225280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dc68e-aa2a-4d8c-ac53-836458220c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.225673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dc68e-aa2a-4d8c-ac53-836458220c80 admin admin] PATH_INFO: `/v3/projects/793afc9e83b74310aff426e6dbfafa91/users/e8f817ea651a40cf8bb0710320065396/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.244278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dc68e-aa2a-4d8c-ac53-836458220c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793afc9e83b74310aff426e6dbfafa91, user_id=e8f817ea651a40cf8bb0710320065396, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:24.245356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WARNING py.warnings [None req-038dc68e-aa2a-4d8c-ac53-836458220c80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:00:24.245356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: warnings.warn(msg) May 26 17:00:24.245356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: May 26 17:00:24.247279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dc68e-aa2a-4d8c-ac53-836458220c80 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:24.381014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 760/1501] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:00:24 2022] PUT /identity/v3/projects/793afc9e83b74310aff426e6dbfafa91/users/e8f817ea651a40cf8bb0710320065396/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:24.394676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd4d2-50ed-462d-b439-63df22ac2af3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.394969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd4d2-50ed-462d-b439-63df22ac2af3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.395288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd4d2-50ed-462d-b439-63df22ac2af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.425335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-55ffd4d2-50ed-462d-b439-63df22ac2af3 None None] MFA Rules not processed for user `e8f817ea651a40cf8bb0710320065396`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:24.426678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-55ffd4d2-50ed-462d-b439-63df22ac2af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:24.507259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 742/1502] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:00:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:24.525398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25a25-d5d5-421d-a52c-2611c3483546 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.525689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25a25-d5d5-421d-a52c-2611c3483546 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.525967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25a25-d5d5-421d-a52c-2611c3483546 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.527339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 761/1503] 10.222.0.93 () {54 vars in 963 bytes} [Thu May 26 17:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:00:24.532653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e6222-d038-4efa-b643-f94786f69e87 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.532829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e6222-d038-4efa-b643-f94786f69e87 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.533090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e6222-d038-4efa-b643-f94786f69e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.552582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-2a8e6222-d038-4efa-b643-f94786f69e87 None None] MFA Rules not processed for user `68cb539d18194ce6a0ad60f206699d78`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:24.553804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2a8e6222-d038-4efa-b643-f94786f69e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:24.602951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:24.611040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 743/1504] 10.222.0.93 () {58 vars in 1060 bytes} [Thu May 26 17:00:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:24.619432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25a25-d5d5-421d-a52c-2611c3483546 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:24.631539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25a25-d5d5-421d-a52c-2611c3483546 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:24.635222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d8904-1706-4404-a570-704e90655938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:24.635909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d8904-1706-4404-a570-704e90655938 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.639415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d8904-1706-4404-a570-704e90655938 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.639415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d8904-1706-4404-a570-704e90655938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.645767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d8904-1706-4404-a570-704e90655938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:24.647235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d8904-1706-4404-a570-704e90655938 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:24.657286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 762/1505] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:00:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:24.710540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7716c-c233-4b56-b3e7-8939e6de274b None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.710865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7716c-c233-4b56-b3e7-8939e6de274b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.711150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7716c-c233-4b56-b3e7-8939e6de274b None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.712861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 744/1506] 10.222.0.93 () {52 vars in 829 bytes} [Thu May 26 17:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:00:24.758854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d8904-1706-4404-a570-704e90655938 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:24.829256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d8904-1706-4404-a570-704e90655938 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:24.834144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:24.835046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.835328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.835635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] PATH_INFO: `/v3/users/e8f817ea651a40cf8bb0710320065396` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.837156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f817ea651a40cf8bb0710320065396)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:24.838206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WARNING py.warnings [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:00:24.838206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: warnings.warn(msg) May 26 17:00:24.838206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: May 26 17:00:24.839424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:25.140566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f817ea651a40cf8bb0710320065396'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.462571 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f817ea651a40cf8bb0710320065396'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.476196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f817ea651a40cf8bb0710320065396'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.493026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:25.495654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f817ea651a40cf8bb0710320065396'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.496506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f817ea651a40cf8bb0710320065396'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.502676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 763/1507] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:00:24 2022] DELETE /identity/v3/users/e8f817ea651a40cf8bb0710320065396 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:25.507225 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db710de-3bb3-4bb6-a488-be59b84b1dff None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:25.507635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db710de-3bb3-4bb6-a488-be59b84b1dff None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:25.507918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db710de-3bb3-4bb6-a488-be59b84b1dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:25.526603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0db710de-3bb3-4bb6-a488-be59b84b1dff None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:25.527820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0db710de-3bb3-4bb6-a488-be59b84b1dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:25.598886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 745/1508] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:25.614017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:25.615207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:25.680675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162ba3d-8408-4dc1-94ef-723fc0fbe68f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:25.684568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669ac59-2d55-4a17-a21d-eebc62c1b1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:25.685270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ac59-2d55-4a17-a21d-eebc62c1b1ec service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:25.685559 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ac59-2d55-4a17-a21d-eebc62c1b1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:25.686086 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ac59-2d55-4a17-a21d-eebc62c1b1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:25.696795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669ac59-2d55-4a17-a21d-eebc62c1b1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:25.698293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669ac59-2d55-4a17-a21d-eebc62c1b1ec service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:25.709772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 764/1509] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:26.288895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db710de-3bb3-4bb6-a488-be59b84b1dff None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:26.290638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0db710de-3bb3-4bb6-a488-be59b84b1dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:26.304123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db710de-3bb3-4bb6-a488-be59b84b1dff None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:26.312643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:26.314193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:26.317940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:26.317940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] PATH_INFO: `/v3/projects/793afc9e83b74310aff426e6dbfafa91` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:26.317940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=793afc9e83b74310aff426e6dbfafa91)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:26.319406 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING py.warnings [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:00:26.319406 dv-cinder-836070-4-smb devstack@keystone.service[97428]: warnings.warn(msg) May 26 17:00:26.319406 dv-cinder-836070-4-smb devstack@keystone.service[97428]: May 26 17:00:26.321989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:26.476031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793afc9e83b74310aff426e6dbfafa91', 'request_id': 'req-9d80d0db-d5c4-4148-91c2-a34261c222eb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.491128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793afc9e83b74310aff426e6dbfafa91', 'request_id': 'req-9d80d0db-d5c4-4148-91c2-a34261c222eb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.498372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793afc9e83b74310aff426e6dbfafa91', 'request_id': 'req-9d80d0db-d5c4-4148-91c2-a34261c222eb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.594241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] The token cache is being invalidate because project 793afc9e83b74310aff426e6dbfafa91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:26.594620 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.595597 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9d80d0db-d5c4-4148-91c2-a34261c222eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.597437 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 746/1510] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:00:26 2022] DELETE /identity/v3/projects/793afc9e83b74310aff426e6dbfafa91 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:35.704308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:36.590615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:19.188983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31b211-daf3-49d6-be26-3b6a251be956 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:19.189609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31b211-daf3-49d6-be26-3b6a251be956 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:19.189609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31b211-daf3-49d6-be26-3b6a251be956 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:19.191449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:02:19.196628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6093ea-00c4-4795-b6b5-252aed5fb9a3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:19.197145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6093ea-00c4-4795-b6b5-252aed5fb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:19.197252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6093ea-00c4-4795-b6b5-252aed5fb9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:19.216689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-9f6093ea-00c4-4795-b6b5-252aed5fb9a3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:19.217898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9f6093ea-00c4-4795-b6b5-252aed5fb9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:19.280292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:19.460979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31b211-daf3-49d6-be26-3b6a251be956 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:19.462777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-cc31b211-daf3-49d6-be26-3b6a251be956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:19.547995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31b211-daf3-49d6-be26-3b6a251be956 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:19.554583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30dbc1-90f8-4de1-b824-1b65594713e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:19.555253 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30dbc1-90f8-4de1-b824-1b65594713e5 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:19.557055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30dbc1-90f8-4de1-b824-1b65594713e5 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:19.557055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30dbc1-90f8-4de1-b824-1b65594713e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:19.566186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30dbc1-90f8-4de1-b824-1b65594713e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:19.568076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30dbc1-90f8-4de1-b824-1b65594713e5 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:19.579174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 766/1513] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:20.481102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03384ff-a611-4bd7-a66e-c6d061baedcf None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:20.481713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03384ff-a611-4bd7-a66e-c6d061baedcf None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:20.481713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03384ff-a611-4bd7-a66e-c6d061baedcf None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:20.483045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:02:20.489981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd121-a72b-4e65-8ddd-335fe5dc582b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:20.490580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd121-a72b-4e65-8ddd-335fe5dc582b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:20.490580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd121-a72b-4e65-8ddd-335fe5dc582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:20.514385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-65dfd121-a72b-4e65-8ddd-335fe5dc582b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:20.515638 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-65dfd121-a72b-4e65-8ddd-335fe5dc582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:20.524544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:20.678593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03384ff-a611-4bd7-a66e-c6d061baedcf None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:20.695058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03384ff-a611-4bd7-a66e-c6d061baedcf None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:20.701193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5523d13-ef51-4e98-b165-8ed7ae6d056d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:20.701844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5523d13-ef51-4e98-b165-8ed7ae6d056d service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:20.702180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5523d13-ef51-4e98-b165-8ed7ae6d056d service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:20.702570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5523d13-ef51-4e98-b165-8ed7ae6d056d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:20.712340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5523d13-ef51-4e98-b165-8ed7ae6d056d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:20.713981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5523d13-ef51-4e98-b165-8ed7ae6d056d service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:20.724820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 749/1516] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:20.739221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d5333-422a-4131-ba0d-d0732fbdf7c3 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:20.739617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d5333-422a-4131-ba0d-d0732fbdf7c3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:20.739906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d5333-422a-4131-ba0d-d0732fbdf7c3 None None] PATH_INFO: `/v3` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:20.741420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 768/1517] 10.222.0.72 () {54 vars in 925 bytes} [Thu May 26 17:02:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:20.748910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a5f2-aa40-43f0-9ace-ef0a79cee101 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:20.749253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a5f2-aa40-43f0-9ace-ef0a79cee101 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:20.749472 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a5f2-aa40-43f0-9ace-ef0a79cee101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:20.771649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3db0a5f2-aa40-43f0-9ace-ef0a79cee101 None None] MFA Rules not processed for user `bae184afff284dcaa228859902e92191`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:20.773241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3db0a5f2-aa40-43f0-9ace-ef0a79cee101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:20.848870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 750/1518] 10.222.0.72 () {58 vars in 1015 bytes} [Thu May 26 17:02:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:30.508780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=37 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:30.669998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a85d3-e9bf-4e70-bdf6-2da380bcc5f1 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:30.670284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a85d3-e9bf-4e70-bdf6-2da380bcc5f1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:30.670563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a85d3-e9bf-4e70-bdf6-2da380bcc5f1 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:30.672023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 769/1519] 10.222.0.93 () {54 vars in 960 bytes} [Thu May 26 17:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:02:30.677852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ac012-db24-450f-be11-d771fbcf9427 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:30.678349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ac012-db24-450f-be11-d771fbcf9427 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:30.678460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ac012-db24-450f-be11-d771fbcf9427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:30.696599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-950ac012-db24-450f-be11-d771fbcf9427 None None] MFA Rules not processed for user `bae184afff284dcaa228859902e92191`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:30.697801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-950ac012-db24-450f-be11-d771fbcf9427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:30.707020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 751/1520] 10.222.0.93 () {58 vars in 1057 bytes} [Thu May 26 17:02:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:30.714833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a85d3-e9bf-4e70-bdf6-2da380bcc5f1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:30.728619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a85d3-e9bf-4e70-bdf6-2da380bcc5f1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:30.733651 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd3bf-4caa-4811-95fb-4ebc50bdfe61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:30.734299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd3bf-4caa-4811-95fb-4ebc50bdfe61 service placement] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:30.734587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd3bf-4caa-4811-95fb-4ebc50bdfe61 service placement] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:30.734895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd3bf-4caa-4811-95fb-4ebc50bdfe61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:30.744631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efd3bf-4caa-4811-95fb-4ebc50bdfe61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:30.746275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efd3bf-4caa-4811-95fb-4ebc50bdfe61 service placement] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:30.757278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 770/1521] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:02:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:32.054745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21977a-4d90-483c-8168-58cb7beac4f6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:32.055321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21977a-4d90-483c-8168-58cb7beac4f6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:32.055321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21977a-4d90-483c-8168-58cb7beac4f6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:32.056750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:02:32.065092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fffec4-da3d-445c-ade4-234897bb38b3 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:32.065665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fffec4-da3d-445c-ade4-234897bb38b3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:32.065665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fffec4-da3d-445c-ade4-234897bb38b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:32.086833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-76fffec4-da3d-445c-ade4-234897bb38b3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:32.088082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-76fffec4-da3d-445c-ade4-234897bb38b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:32.096779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:32.252385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21977a-4d90-483c-8168-58cb7beac4f6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:32.266797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21977a-4d90-483c-8168-58cb7beac4f6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:32.272718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4877f60-93e2-4a3a-8ea2-c2afa9e0e7e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:32.273375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4877f60-93e2-4a3a-8ea2-c2afa9e0e7e5 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:32.273655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4877f60-93e2-4a3a-8ea2-c2afa9e0e7e5 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:32.273933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4877f60-93e2-4a3a-8ea2-c2afa9e0e7e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:32.282713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4877f60-93e2-4a3a-8ea2-c2afa9e0e7e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:32.285853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4877f60-93e2-4a3a-8ea2-c2afa9e0e7e5 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:32.296329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 753/1524] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:33.180592 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b098d98-f558-48d2-9fae-f68be9a58523 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.181258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b098d98-f558-48d2-9fae-f68be9a58523 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.181258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b098d98-f558-48d2-9fae-f68be9a58523 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.182544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:02:33.188337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b8ad6-3dda-436b-8f0c-7b21e32c8be5 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.189160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b8ad6-3dda-436b-8f0c-7b21e32c8be5 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.189334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b8ad6-3dda-436b-8f0c-7b21e32c8be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.208942 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-4a9b8ad6-3dda-436b-8f0c-7b21e32c8be5 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:33.210160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4a9b8ad6-3dda-436b-8f0c-7b21e32c8be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:33.218517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:33.371826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b098d98-f558-48d2-9fae-f68be9a58523 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:33.386734 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b098d98-f558-48d2-9fae-f68be9a58523 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:33.392054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6278a4-61ce-4d66-ac96-3f61c94f1db8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:33.392725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6278a4-61ce-4d66-ac96-3f61c94f1db8 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.393006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6278a4-61ce-4d66-ac96-3f61c94f1db8 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.393278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6278a4-61ce-4d66-ac96-3f61c94f1db8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.402715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6278a4-61ce-4d66-ac96-3f61c94f1db8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:33.404433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6278a4-61ce-4d66-ac96-3f61c94f1db8 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:33.415369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 773/1527] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:37.831410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64396150-37f8-429c-8c84-1912d99e9b43 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.832343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64396150-37f8-429c-8c84-1912d99e9b43 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.832343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64396150-37f8-429c-8c84-1912d99e9b43 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.833441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:02:37.841575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbe0f3-14fc-44dd-ba71-03b6082215a6 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.842162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbe0f3-14fc-44dd-ba71-03b6082215a6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.842582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbe0f3-14fc-44dd-ba71-03b6082215a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.872168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5abbe0f3-14fc-44dd-ba71-03b6082215a6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:37.874164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5abbe0f3-14fc-44dd-ba71-03b6082215a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:37.885569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:37.924764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64396150-37f8-429c-8c84-1912d99e9b43 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:37.926485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-64396150-37f8-429c-8c84-1912d99e9b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:37.987906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64396150-37f8-429c-8c84-1912d99e9b43 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:37.991510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb699ad-e36f-40a2-afa3-7400e7107fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:37.992284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb699ad-e36f-40a2-afa3-7400e7107fbd service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.992562 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb699ad-e36f-40a2-afa3-7400e7107fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.992839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb699ad-e36f-40a2-afa3-7400e7107fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:38.002405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb699ad-e36f-40a2-afa3-7400e7107fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:38.003939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb699ad-e36f-40a2-afa3-7400e7107fbd service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:38.009420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:38.014087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 756/1530] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:40.318937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca18ac-8a98-4ccd-be29-e404e5c11a29 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.319555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca18ac-8a98-4ccd-be29-e404e5c11a29 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.319555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca18ac-8a98-4ccd-be29-e404e5c11a29 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.321570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:02:40.327607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db1a7f-9196-43cf-a67d-016aeeb1dae1 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.328191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db1a7f-9196-43cf-a67d-016aeeb1dae1 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.328191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db1a7f-9196-43cf-a67d-016aeeb1dae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.347108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-21db1a7f-9196-43cf-a67d-016aeeb1dae1 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:40.348350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-21db1a7f-9196-43cf-a67d-016aeeb1dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:40.356231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:40.393310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca18ac-8a98-4ccd-be29-e404e5c11a29 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.409756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca18ac-8a98-4ccd-be29-e404e5c11a29 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.413697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9ab5c-c55c-42ba-bcfd-812a7e9b5860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.414403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9ab5c-c55c-42ba-bcfd-812a7e9b5860 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.414739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9ab5c-c55c-42ba-bcfd-812a7e9b5860 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.415071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9ab5c-c55c-42ba-bcfd-812a7e9b5860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.425514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9ab5c-c55c-42ba-bcfd-812a7e9b5860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.426976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9ab5c-c55c-42ba-bcfd-812a7e9b5860 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.437968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 776/1533] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:44.355385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf592-fcee-48f1-b1a4-e29d004a410b None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.355956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf592-fcee-48f1-b1a4-e29d004a410b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.356082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf592-fcee-48f1-b1a4-e29d004a410b None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.357380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:02:44.362941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160260-f11f-4cda-b667-2affa02e9ba5 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.363421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160260-f11f-4cda-b667-2affa02e9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.363531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160260-f11f-4cda-b667-2affa02e9ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.382902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-19160260-f11f-4cda-b667-2affa02e9ba5 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:44.384181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-19160260-f11f-4cda-b667-2affa02e9ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:44.392099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:44.674326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf592-fcee-48f1-b1a4-e29d004a410b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.676218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-639bf592-fcee-48f1-b1a4-e29d004a410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:44.741756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf592-fcee-48f1-b1a4-e29d004a410b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.745947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26055d76-92d9-4d26-8071-a6857e89fb83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.746643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26055d76-92d9-4d26-8071-a6857e89fb83 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.746951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26055d76-92d9-4d26-8071-a6857e89fb83 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.747234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26055d76-92d9-4d26-8071-a6857e89fb83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.757658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26055d76-92d9-4d26-8071-a6857e89fb83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.759217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26055d76-92d9-4d26-8071-a6857e89fb83 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.769088 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 759/1536] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:47.066526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef32e03-e917-4aa9-9bdc-d75513a95dfa None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.067131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef32e03-e917-4aa9-9bdc-d75513a95dfa None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.067392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef32e03-e917-4aa9-9bdc-d75513a95dfa None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.068865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:02:47.075044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cc44b-e45c-4379-9223-a2e007666baa None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.082211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cc44b-e45c-4379-9223-a2e007666baa None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.082211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cc44b-e45c-4379-9223-a2e007666baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.098319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-6b3cc44b-e45c-4379-9223-a2e007666baa None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:47.099550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6b3cc44b-e45c-4379-9223-a2e007666baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.109588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:47.388172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef32e03-e917-4aa9-9bdc-d75513a95dfa None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.393943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2ef32e03-e917-4aa9-9bdc-d75513a95dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.409692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef32e03-e917-4aa9-9bdc-d75513a95dfa None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.414751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182ea27-6544-40fb-a324-77e574cfefa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.415399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ea27-6544-40fb-a324-77e574cfefa6 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.415708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ea27-6544-40fb-a324-77e574cfefa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.415979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ea27-6544-40fb-a324-77e574cfefa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.426085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182ea27-6544-40fb-a324-77e574cfefa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.427634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182ea27-6544-40fb-a324-77e574cfefa6 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.438039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 779/1539] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:57.092666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=32 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:57.433366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=33 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:24.651229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4d1b-d77b-456d-8f48-7199447767d6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:24.652311 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4d1b-d77b-456d-8f48-7199447767d6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:24.652311 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4d1b-d77b-456d-8f48-7199447767d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:24.688143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-996f4d1b-d77b-456d-8f48-7199447767d6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:24.689459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-996f4d1b-d77b-456d-8f48-7199447767d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:24.702934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 761/1540] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:24.714137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1523276-0b1d-42f3-ae67-a48651ad89c3 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:24.715000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1523276-0b1d-42f3-ae67-a48651ad89c3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:24.715000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1523276-0b1d-42f3-ae67-a48651ad89c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:24.740718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c1523276-0b1d-42f3-ae67-a48651ad89c3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:24.741945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c1523276-0b1d-42f3-ae67-a48651ad89c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:24.754717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 780/1541] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:24.760926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f4d1b-d77b-456d-8f48-7199447767d6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:24.792521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f4d1b-d77b-456d-8f48-7199447767d6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:24.804303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de315ea4-74d8-4729-ac56-a43359a19ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:24.805996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315ea4-74d8-4729-ac56-a43359a19ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:24.807143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315ea4-74d8-4729-ac56-a43359a19ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:24.807638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315ea4-74d8-4729-ac56-a43359a19ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:24.809006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de315ea4-74d8-4729-ac56-a43359a19ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:24.809546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de315ea4-74d8-4729-ac56-a43359a19ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:24.813086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de315ea4-74d8-4729-ac56-a43359a19ef6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:24.853569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 762/1542] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:04:24.862504 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1523276-0b1d-42f3-ae67-a48651ad89c3 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:24.877983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1523276-0b1d-42f3-ae67-a48651ad89c3 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:24.888336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201426c4-3682-4d44-a4ae-db93f693cac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:24.889024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201426c4-3682-4d44-a4ae-db93f693cac4 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:24.889294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201426c4-3682-4d44-a4ae-db93f693cac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:24.889641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201426c4-3682-4d44-a4ae-db93f693cac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:24.890354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201426c4-3682-4d44-a4ae-db93f693cac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:24.892285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201426c4-3682-4d44-a4ae-db93f693cac4 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:24.937066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25123d6-d8e4-4910-9d2e-c3494e2aa9f1 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:24.937478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25123d6-d8e4-4910-9d2e-c3494e2aa9f1 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:24.937874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25123d6-d8e4-4910-9d2e-c3494e2aa9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:24.974993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e25123d6-d8e4-4910-9d2e-c3494e2aa9f1 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:24.977540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e25123d6-d8e4-4910-9d2e-c3494e2aa9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:24.977752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 781/1543] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:24 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:04:24.982074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e72b-f285-4126-858d-009127432c86 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:24.982415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e72b-f285-4126-858d-009127432c86 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:24.982688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e72b-f285-4126-858d-009127432c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.020697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-20d1e72b-f285-4126-858d-009127432c86 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.021961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-20d1e72b-f285-4126-858d-009127432c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.117381 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 763/1544] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.119555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25123d6-d8e4-4910-9d2e-c3494e2aa9f1 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.139544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25123d6-d8e4-4910-9d2e-c3494e2aa9f1 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.149567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7855a48-05cd-4d7a-9070-1203e35a50c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.152825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7855a48-05cd-4d7a-9070-1203e35a50c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.152825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7855a48-05cd-4d7a-9070-1203e35a50c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.152825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7855a48-05cd-4d7a-9070-1203e35a50c6 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.153497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7855a48-05cd-4d7a-9070-1203e35a50c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.157958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7855a48-05cd-4d7a-9070-1203e35a50c6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.192241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 782/1545] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:25.194178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4248d-1da3-43bb-998c-14fd27975bae None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.194549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4248d-1da3-43bb-998c-14fd27975bae None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.194863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4248d-1da3-43bb-998c-14fd27975bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.232168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d1c4248d-1da3-43bb-998c-14fd27975bae None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.233489 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d1c4248d-1da3-43bb-998c-14fd27975bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.248176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 783/1546] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.256179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac086a-e060-44c7-ab45-c97f53ff971b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.256179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac086a-e060-44c7-ab45-c97f53ff971b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.256179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac086a-e060-44c7-ab45-c97f53ff971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.270567 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e9ac086a-e060-44c7-ab45-c97f53ff971b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.275820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e9ac086a-e060-44c7-ab45-c97f53ff971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.282882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 764/1547] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:25.285105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ea30c-e5e0-4247-9760-e9bc31abd97e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.285646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ea30c-e5e0-4247-9760-e9bc31abd97e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.286139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ea30c-e5e0-4247-9760-e9bc31abd97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.288160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 784/1548] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.289652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac086a-e060-44c7-ab45-c97f53ff971b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.302729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac086a-e060-44c7-ab45-c97f53ff971b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.307698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e52e25-8a27-4ab7-bc0c-52c4718917a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.308500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e52e25-8a27-4ab7-bc0c-52c4718917a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.308787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e52e25-8a27-4ab7-bc0c-52c4718917a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.314362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e52e25-8a27-4ab7-bc0c-52c4718917a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.314362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e52e25-8a27-4ab7-bc0c-52c4718917a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:25.314362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e52e25-8a27-4ab7-bc0c-52c4718917a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.314362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WARNING py.warnings [None req-16e52e25-8a27-4ab7-bc0c-52c4718917a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:04:25.314362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: warnings.warn(msg) May 26 17:04:25.314362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: May 26 17:04:25.314362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e52e25-8a27-4ab7-bc0c-52c4718917a7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.324630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5d3ea30c-e5e0-4247-9760-e9bc31abd97e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.326188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5d3ea30c-e5e0-4247-9760-e9bc31abd97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.328931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 785/1549] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:25.330829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1762e0f-dd16-4ed0-8f68-a4668a4cfec4 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.331319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1762e0f-dd16-4ed0-8f68-a4668a4cfec4 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.331821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1762e0f-dd16-4ed0-8f68-a4668a4cfec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.340204 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 765/1550] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.341345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ea30c-e5e0-4247-9760-e9bc31abd97e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.358171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ea30c-e5e0-4247-9760-e9bc31abd97e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.368248 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544698-a522-47bd-b8fd-e6a6edc3eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.369259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544698-a522-47bd-b8fd-e6a6edc3eb34 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.369546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544698-a522-47bd-b8fd-e6a6edc3eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.369819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544698-a522-47bd-b8fd-e6a6edc3eb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.370553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84544698-a522-47bd-b8fd-e6a6edc3eb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.371297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d1762e0f-dd16-4ed0-8f68-a4668a4cfec4 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.374431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d1762e0f-dd16-4ed0-8f68-a4668a4cfec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.374626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84544698-a522-47bd-b8fd-e6a6edc3eb34 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.383127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 786/1551] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.383127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1762e0f-dd16-4ed0-8f68-a4668a4cfec4 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.394331 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 766/1552] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:25.395300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544698-a522-47bd-b8fd-e6a6edc3eb34 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.398388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1762e0f-dd16-4ed0-8f68-a4668a4cfec4 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.403910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c981f6a-64d5-4dd8-8b55-86068793ff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.404456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c981f6a-64d5-4dd8-8b55-86068793ff0d admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.404741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c981f6a-64d5-4dd8-8b55-86068793ff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.405017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c981f6a-64d5-4dd8-8b55-86068793ff0d admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.405607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544698-a522-47bd-b8fd-e6a6edc3eb34 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.405743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c981f6a-64d5-4dd8-8b55-86068793ff0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:25.406145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c981f6a-64d5-4dd8-8b55-86068793ff0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.407853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c981f6a-64d5-4dd8-8b55-86068793ff0d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.410223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538251c-10c9-4cb0-9d44-d67bd7bed151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.410876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538251c-10c9-4cb0-9d44-d67bd7bed151 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.411146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538251c-10c9-4cb0-9d44-d67bd7bed151 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.411425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538251c-10c9-4cb0-9d44-d67bd7bed151 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.412154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538251c-10c9-4cb0-9d44-d67bd7bed151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.413190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING py.warnings [None req-b538251c-10c9-4cb0-9d44-d67bd7bed151 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:04:25.413190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: warnings.warn(msg) May 26 17:04:25.413190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: May 26 17:04:25.414357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538251c-10c9-4cb0-9d44-d67bd7bed151 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.420381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 787/1553] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:25.421764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fd34-7d3a-4993-894d-0c5db4684c28 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.422060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fd34-7d3a-4993-894d-0c5db4684c28 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.422335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fd34-7d3a-4993-894d-0c5db4684c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.445873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5368fd34-7d3a-4993-894d-0c5db4684c28 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.445873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5368fd34-7d3a-4993-894d-0c5db4684c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.453297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 788/1554] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.455134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eda1e-11bc-4e38-8e6e-25ed39bd20d0 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.455672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eda1e-11bc-4e38-8e6e-25ed39bd20d0 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.456158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eda1e-11bc-4e38-8e6e-25ed39bd20d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.476340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-173eda1e-11bc-4e38-8e6e-25ed39bd20d0 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.477521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-173eda1e-11bc-4e38-8e6e-25ed39bd20d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.485406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 789/1555] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.486692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6a870-76a9-4fb7-932f-d31c4b160fc1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.486978 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6a870-76a9-4fb7-932f-d31c4b160fc1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.487251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6a870-76a9-4fb7-932f-d31c4b160fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.506768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-30e6a870-76a9-4fb7-932f-d31c4b160fc1 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.507997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-30e6a870-76a9-4fb7-932f-d31c4b160fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.516515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 790/1556] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.517813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a20d6d-e5b8-4474-ad82-ab7fada7a8f2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.518079 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a20d6d-e5b8-4474-ad82-ab7fada7a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.518360 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a20d6d-e5b8-4474-ad82-ab7fada7a8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.537324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-03a20d6d-e5b8-4474-ad82-ab7fada7a8f2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.538128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 767/1557] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:25.538535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-03a20d6d-e5b8-4474-ad82-ab7fada7a8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.539514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a4c7e-291f-4e52-a453-367b7ce9e38c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.539896 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a4c7e-291f-4e52-a453-367b7ce9e38c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.540184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a4c7e-291f-4e52-a453-367b7ce9e38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.559108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e67a4c7e-291f-4e52-a453-367b7ce9e38c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.560329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e67a4c7e-291f-4e52-a453-367b7ce9e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.599007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 791/1558] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.599708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a20d6d-e5b8-4474-ad82-ab7fada7a8f2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.611841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a20d6d-e5b8-4474-ad82-ab7fada7a8f2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.616704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e51d-9e0d-41dd-aeac-89ac7e01a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.617539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e51d-9e0d-41dd-aeac-89ac7e01a78b admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.617719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e51d-9e0d-41dd-aeac-89ac7e01a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.618002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e51d-9e0d-41dd-aeac-89ac7e01a78b admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.619417 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e51d-9e0d-41dd-aeac-89ac7e01a78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.621121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e51d-9e0d-41dd-aeac-89ac7e01a78b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.622799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:25.627125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 768/1559] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.628122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a4c7e-291f-4e52-a453-367b7ce9e38c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.639367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 792/1560] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:25.639705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a4c7e-291f-4e52-a453-367b7ce9e38c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.640512 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e51d-9e0d-41dd-aeac-89ac7e01a78b admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.645007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555db6b1-f4d8-45b0-b06f-55a24b8e9c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.645893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555db6b1-f4d8-45b0-b06f-55a24b8e9c97 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.646256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555db6b1-f4d8-45b0-b06f-55a24b8e9c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.646400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555db6b1-f4d8-45b0-b06f-55a24b8e9c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.647015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555db6b1-f4d8-45b0-b06f-55a24b8e9c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.649063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555db6b1-f4d8-45b0-b06f-55a24b8e9c97 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.651178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e51d-9e0d-41dd-aeac-89ac7e01a78b admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.658158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d5d4-0d0d-4e21-b064-c51dc8abc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.664189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d5d4-0d0d-4e21-b064-c51dc8abc2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.664189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d5d4-0d0d-4e21-b064-c51dc8abc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.664189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d5d4-0d0d-4e21-b064-c51dc8abc2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.664189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87d5d4-0d0d-4e21-b064-c51dc8abc2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:25.664189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87d5d4-0d0d-4e21-b064-c51dc8abc2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.664189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87d5d4-0d0d-4e21-b064-c51dc8abc2a8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.674833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 793/1561] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:25.676524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8539e1-cf2b-4a5b-a972-8357f0a5ff08 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.676841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8539e1-cf2b-4a5b-a972-8357f0a5ff08 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.677104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8539e1-cf2b-4a5b-a972-8357f0a5ff08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.696166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-da8539e1-cf2b-4a5b-a972-8357f0a5ff08 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.697952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-da8539e1-cf2b-4a5b-a972-8357f0a5ff08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.706661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 794/1562] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.708014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96574f-0888-4090-8f37-e001a95a461d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.708302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96574f-0888-4090-8f37-e001a95a461d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.708582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96574f-0888-4090-8f37-e001a95a461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.727430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1c96574f-0888-4090-8f37-e001a95a461d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.728676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1c96574f-0888-4090-8f37-e001a95a461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.736589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 795/1563] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.737482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96574f-0888-4090-8f37-e001a95a461d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.747614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96574f-0888-4090-8f37-e001a95a461d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.752160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bc2ae-8f30-4838-bce0-ada22a764193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.752823 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bc2ae-8f30-4838-bce0-ada22a764193 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.754627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bc2ae-8f30-4838-bce0-ada22a764193 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.754627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bc2ae-8f30-4838-bce0-ada22a764193 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.754627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bc2ae-8f30-4838-bce0-ada22a764193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.755044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WARNING py.warnings [None req-4c8bc2ae-8f30-4838-bce0-ada22a764193 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:04:25.755044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: warnings.warn(msg) May 26 17:04:25.755044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: May 26 17:04:25.756278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bc2ae-8f30-4838-bce0-ada22a764193 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.777750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 769/1564] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:25.778784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555db6b1-f4d8-45b0-b06f-55a24b8e9c97 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.783043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:25.841904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555db6b1-f4d8-45b0-b06f-55a24b8e9c97 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.846920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487537a1-9933-44c1-a0bd-fcb2be5636ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.847612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487537a1-9933-44c1-a0bd-fcb2be5636ca admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.847918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487537a1-9933-44c1-a0bd-fcb2be5636ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.848174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487537a1-9933-44c1-a0bd-fcb2be5636ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.849035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487537a1-9933-44c1-a0bd-fcb2be5636ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:25.849344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487537a1-9933-44c1-a0bd-fcb2be5636ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.850963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487537a1-9933-44c1-a0bd-fcb2be5636ca admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.863188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 770/1565] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:25.864476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559153b5-ae8a-445b-80ab-5b88565ded48 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.864765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559153b5-ae8a-445b-80ab-5b88565ded48 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.865045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559153b5-ae8a-445b-80ab-5b88565ded48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.884162 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-559153b5-ae8a-445b-80ab-5b88565ded48 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:25.885383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-559153b5-ae8a-445b-80ab-5b88565ded48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:25.893560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 771/1566] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:25.894232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559153b5-ae8a-445b-80ab-5b88565ded48 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.904120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559153b5-ae8a-445b-80ab-5b88565ded48 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.909128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 796/1567] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:25.909128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bc2ae-8f30-4838-bce0-ada22a764193 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:25.917419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211bf88-a179-4490-971b-8252541af900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.917419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211bf88-a179-4490-971b-8252541af900 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.917419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211bf88-a179-4490-971b-8252541af900 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.917419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211bf88-a179-4490-971b-8252541af900 admin admin] PATH_INFO: `/v3/projects/12f0d5719c724f2eb6b4384c250764b6/users/bc0e583fb8414bde82872ccc4726e5e8/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.920175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bc2ae-8f30-4838-bce0-ada22a764193 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:25.924967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c63b-7eab-4371-942c-78f01d0d7c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:25.925674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c63b-7eab-4371-942c-78f01d0d7c0c admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:25.925958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c63b-7eab-4371-942c-78f01d0d7c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:25.926240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c63b-7eab-4371-942c-78f01d0d7c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:25.926932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4c63b-7eab-4371-942c-78f01d0d7c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.928392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211bf88-a179-4490-971b-8252541af900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f0d5719c724f2eb6b4384c250764b6, user_id=bc0e583fb8414bde82872ccc4726e5e8, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:25.928949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4c63b-7eab-4371-942c-78f01d0d7c0c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:25.929641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING py.warnings [None req-4211bf88-a179-4490-971b-8252541af900 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:04:25.929641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: warnings.warn(msg) May 26 17:04:25.929641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: May 26 17:04:25.932346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211bf88-a179-4490-971b-8252541af900 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.079540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 772/1568] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:25 2022] PUT /identity/v3/projects/12f0d5719c724f2eb6b4384c250764b6/users/bc0e583fb8414bde82872ccc4726e5e8/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:26.080414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211bf88-a179-4490-971b-8252541af900 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.081765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 797/1569] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:25 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:26.086177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c63b-7eab-4371-942c-78f01d0d7c0c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.147404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211bf88-a179-4490-971b-8252541af900 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.150958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c63b-7eab-4371-942c-78f01d0d7c0c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.152516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03932514-3d0a-4e61-86ef-da90e25e5aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.153168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03932514-3d0a-4e61-86ef-da90e25e5aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.153447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03932514-3d0a-4e61-86ef-da90e25e5aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.153719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03932514-3d0a-4e61-86ef-da90e25e5aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.154438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03932514-3d0a-4e61-86ef-da90e25e5aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:26.154741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03932514-3d0a-4e61-86ef-da90e25e5aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.155555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef7de-33da-42d5-9172-054251401aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.156231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef7de-33da-42d5-9172-054251401aff admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.156365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03932514-3d0a-4e61-86ef-da90e25e5aa6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.156515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef7de-33da-42d5-9172-054251401aff admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.156793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef7de-33da-42d5-9172-054251401aff admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.157507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef7de-33da-42d5-9172-054251401aff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:26.157813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef7de-33da-42d5-9172-054251401aff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.159391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef7de-33da-42d5-9172-054251401aff admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.169598 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 773/1570] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:26.170544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03932514-3d0a-4e61-86ef-da90e25e5aa6 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.173694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 798/1571] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:26.174701 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef7de-33da-42d5-9172-054251401aff admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.180233 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03932514-3d0a-4e61-86ef-da90e25e5aa6 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.185341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef7de-33da-42d5-9172-054251401aff admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.185785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03777a22-5103-41f4-bd43-f9df9b57030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.186438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03777a22-5103-41f4-bd43-f9df9b57030f admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.186716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03777a22-5103-41f4-bd43-f9df9b57030f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.186987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03777a22-5103-41f4-bd43-f9df9b57030f admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.187750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03777a22-5103-41f4-bd43-f9df9b57030f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.189640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03777a22-5103-41f4-bd43-f9df9b57030f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.190390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b069-8fe0-4dc2-81c5-4617d7de1ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.191037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b069-8fe0-4dc2-81c5-4617d7de1ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.191330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b069-8fe0-4dc2-81c5-4617d7de1ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.191648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b069-8fe0-4dc2-81c5-4617d7de1ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.192343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2b069-8fe0-4dc2-81c5-4617d7de1ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.194262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2b069-8fe0-4dc2-81c5-4617d7de1ff0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.314338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 774/1572] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:26.318162 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03777a22-5103-41f4-bd43-f9df9b57030f admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.324444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 799/1573] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:26.324444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b069-8fe0-4dc2-81c5-4617d7de1ff0 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.329246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03777a22-5103-41f4-bd43-f9df9b57030f admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.369971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:26.384293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b069-8fe0-4dc2-81c5-4617d7de1ff0 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.386332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fd0b4-e50e-408b-9956-8f1a5cacd6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.386991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fd0b4-e50e-408b-9956-8f1a5cacd6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.387276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fd0b4-e50e-408b-9956-8f1a5cacd6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.387548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fd0b4-e50e-408b-9956-8f1a5cacd6c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.388298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fd0b4-e50e-408b-9956-8f1a5cacd6c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:26.388606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fd0b4-e50e-408b-9956-8f1a5cacd6c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.389768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6642e-2560-40f1-8bcb-e98d492d6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.390194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fd0b4-e50e-408b-9956-8f1a5cacd6c3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.390432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6642e-2560-40f1-8bcb-e98d492d6220 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.390719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6642e-2560-40f1-8bcb-e98d492d6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.390998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6642e-2560-40f1-8bcb-e98d492d6220 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.391793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6642e-2560-40f1-8bcb-e98d492d6220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.393388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6642e-2560-40f1-8bcb-e98d492d6220 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.396029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:26.403825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 775/1574] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:26.407371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 800/1575] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:26.407543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba462-7d6c-4e1f-8d28-50714aee0219 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.407543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba462-7d6c-4e1f-8d28-50714aee0219 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.407783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6642e-2560-40f1-8bcb-e98d492d6220 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.407882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba462-7d6c-4e1f-8d28-50714aee0219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.421131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6642e-2560-40f1-8bcb-e98d492d6220 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.426083 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79c968-21fd-4296-9a82-e26479638654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.426673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79c968-21fd-4296-9a82-e26479638654 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.427231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-9a0ba462-7d6c-4e1f-8d28-50714aee0219 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:26.427355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79c968-21fd-4296-9a82-e26479638654 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.427856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79c968-21fd-4296-9a82-e26479638654 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.428491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9a0ba462-7d6c-4e1f-8d28-50714aee0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:26.429016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79c968-21fd-4296-9a82-e26479638654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.431821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79c968-21fd-4296-9a82-e26479638654 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.436909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 776/1576] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:26.437672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba462-7d6c-4e1f-8d28-50714aee0219 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.448240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba462-7d6c-4e1f-8d28-50714aee0219 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.453840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b134-45f0-4fbd-b387-44b5bdc6705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.454624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b134-45f0-4fbd-b387-44b5bdc6705a admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.457739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b134-45f0-4fbd-b387-44b5bdc6705a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.457739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b134-45f0-4fbd-b387-44b5bdc6705a admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.457739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1b134-45f0-4fbd-b387-44b5bdc6705a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.458837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1b134-45f0-4fbd-b387-44b5bdc6705a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.519198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 801/1577] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:26.519900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79c968-21fd-4296-9a82-e26479638654 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.529544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79c968-21fd-4296-9a82-e26479638654 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.534967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6da1d6-ba92-42ae-bcd7-b589730f4df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.541040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6da1d6-ba92-42ae-bcd7-b589730f4df7 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.541040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6da1d6-ba92-42ae-bcd7-b589730f4df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.541040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6da1d6-ba92-42ae-bcd7-b589730f4df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.541040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6da1d6-ba92-42ae-bcd7-b589730f4df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.541416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 777/1578] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:26.541416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b134-45f0-4fbd-b387-44b5bdc6705a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.541597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6da1d6-ba92-42ae-bcd7-b589730f4df7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.602374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b134-45f0-4fbd-b387-44b5bdc6705a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.607481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e82f4-49a7-4eef-829b-08fc19de12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.608236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e82f4-49a7-4eef-829b-08fc19de12bf admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.608520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e82f4-49a7-4eef-829b-08fc19de12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.608814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e82f4-49a7-4eef-829b-08fc19de12bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.609507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e82f4-49a7-4eef-829b-08fc19de12bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.611101 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e82f4-49a7-4eef-829b-08fc19de12bf admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.621474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 778/1579] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:26.622341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e82f4-49a7-4eef-829b-08fc19de12bf admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.631814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e82f4-49a7-4eef-829b-08fc19de12bf admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.636305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3f665-4776-4e54-8c5d-9b21da5c2e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.636962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f665-4776-4e54-8c5d-9b21da5c2e47 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.637271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f665-4776-4e54-8c5d-9b21da5c2e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.637547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f665-4776-4e54-8c5d-9b21da5c2e47 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.638222 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3f665-4776-4e54-8c5d-9b21da5c2e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.640301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3f665-4776-4e54-8c5d-9b21da5c2e47 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.646742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 802/1580] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:26.647734 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6da1d6-ba92-42ae-bcd7-b589730f4df7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.712068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6da1d6-ba92-42ae-bcd7-b589730f4df7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.717190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a97d3-23d8-4666-af61-859a12742014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.717886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a97d3-23d8-4666-af61-859a12742014 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.718167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a97d3-23d8-4666-af61-859a12742014 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.718440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a97d3-23d8-4666-af61-859a12742014 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.719163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a97d3-23d8-4666-af61-859a12742014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.720822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a97d3-23d8-4666-af61-859a12742014 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.735146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 803/1581] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:26.735146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a97d3-23d8-4666-af61-859a12742014 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.737059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 779/1582] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:26.742029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3f665-4776-4e54-8c5d-9b21da5c2e47 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.742029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-22c3f665-4776-4e54-8c5d-9b21da5c2e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:26.745384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a97d3-23d8-4666-af61-859a12742014 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.753152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce062d-b8be-429d-89fd-2893d4eacbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.754347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce062d-b8be-429d-89fd-2893d4eacbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.754347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce062d-b8be-429d-89fd-2893d4eacbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.754347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce062d-b8be-429d-89fd-2893d4eacbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.755102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce062d-b8be-429d-89fd-2893d4eacbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.757052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce062d-b8be-429d-89fd-2893d4eacbe6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.804014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3f665-4776-4e54-8c5d-9b21da5c2e47 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.844089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:26.853558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2a9fd-2864-4140-b3e6-21d2a206d174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.854216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2a9fd-2864-4140-b3e6-21d2a206d174 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.854505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2a9fd-2864-4140-b3e6-21d2a206d174 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.854876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2a9fd-2864-4140-b3e6-21d2a206d174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.864558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2a9fd-2864-4140-b3e6-21d2a206d174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.866045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2a9fd-2864-4140-b3e6-21d2a206d174 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.876363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 780/1583] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:26.877097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2a9fd-2864-4140-b3e6-21d2a206d174 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.886753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2a9fd-2864-4140-b3e6-21d2a206d174 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.892077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a819ca5-d993-4e1b-8c5f-6e7844750ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.892784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a819ca5-d993-4e1b-8c5f-6e7844750ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.893075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a819ca5-d993-4e1b-8c5f-6e7844750ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.893345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a819ca5-d993-4e1b-8c5f-6e7844750ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.894078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a819ca5-d993-4e1b-8c5f-6e7844750ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.895166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 804/1584] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:26.895957 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a819ca5-d993-4e1b-8c5f-6e7844750ef5 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.896204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce062d-b8be-429d-89fd-2893d4eacbe6 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.908230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 781/1585] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:26.909136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a819ca5-d993-4e1b-8c5f-6e7844750ef5 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:26.920465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a819ca5-d993-4e1b-8c5f-6e7844750ef5 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.970388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce062d-b8be-429d-89fd-2893d4eacbe6 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:26.975375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2f74-a30f-47cd-8792-5c08789d3488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.976208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2f74-a30f-47cd-8792-5c08789d3488 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.976514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2f74-a30f-47cd-8792-5c08789d3488 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.976791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2f74-a30f-47cd-8792-5c08789d3488 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.977528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2f74-a30f-47cd-8792-5c08789d3488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.977716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f691f-3cb3-4f62-87f3-2c98118d6b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:26.978965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f691f-3cb3-4f62-87f3-2c98118d6b10 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:26.979245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f691f-3cb3-4f62-87f3-2c98118d6b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:26.979534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f691f-3cb3-4f62-87f3-2c98118d6b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:26.980229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2f74-a30f-47cd-8792-5c08789d3488 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.980358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f691f-3cb3-4f62-87f3-2c98118d6b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:26.981895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f691f-3cb3-4f62-87f3-2c98118d6b10 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:26.993876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 782/1586] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:26.993876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f691f-3cb3-4f62-87f3-2c98118d6b10 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.002749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f691f-3cb3-4f62-87f3-2c98118d6b10 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.007604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0028256-076b-4cd6-9847-b107a052b430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.008268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028256-076b-4cd6-9847-b107a052b430 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.008570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028256-076b-4cd6-9847-b107a052b430 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.008847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028256-076b-4cd6-9847-b107a052b430 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.009605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0028256-076b-4cd6-9847-b107a052b430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.011589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0028256-076b-4cd6-9847-b107a052b430 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.118456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 783/1587] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:27.119460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0028256-076b-4cd6-9847-b107a052b430 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.129498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0028256-076b-4cd6-9847-b107a052b430 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.134225 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8133f3-52a2-476f-96e4-4286ef026872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.135095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8133f3-52a2-476f-96e4-4286ef026872 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.135387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8133f3-52a2-476f-96e4-4286ef026872 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.135703 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8133f3-52a2-476f-96e4-4286ef026872 admin admin] PATH_INFO: `/v3/projects/33a805ff6bbb4403b077283546b43297/users/f4794216544c4b969910eb48c2769f3a/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.151707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8133f3-52a2-476f-96e4-4286ef026872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a805ff6bbb4403b077283546b43297, user_id=f4794216544c4b969910eb48c2769f3a, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.154490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8133f3-52a2-476f-96e4-4286ef026872 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.177210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 805/1588] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:26 2022] POST /identity/v3/users => generated 286 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:27.178134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2f74-a30f-47cd-8792-5c08789d3488 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.188676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2f74-a30f-47cd-8792-5c08789d3488 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.193644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb0282-8bd5-4c77-9b5a-a0abb9b78b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.194454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb0282-8bd5-4c77-9b5a-a0abb9b78b3b admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.194802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb0282-8bd5-4c77-9b5a-a0abb9b78b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.195254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb0282-8bd5-4c77-9b5a-a0abb9b78b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.196008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb0282-8bd5-4c77-9b5a-a0abb9b78b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.197631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb0282-8bd5-4c77-9b5a-a0abb9b78b3b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.211397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 806/1589] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:27.211397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb0282-8bd5-4c77-9b5a-a0abb9b78b3b admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.222329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb0282-8bd5-4c77-9b5a-a0abb9b78b3b admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.227763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4a0da-d63b-42fd-92d9-3b0fae3bf6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.229439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4a0da-d63b-42fd-92d9-3b0fae3bf6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.230247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4a0da-d63b-42fd-92d9-3b0fae3bf6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.230854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4a0da-d63b-42fd-92d9-3b0fae3bf6c0 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.232352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4a0da-d63b-42fd-92d9-3b0fae3bf6c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.235332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4a0da-d63b-42fd-92d9-3b0fae3bf6c0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.245577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 784/1590] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:27 2022] PUT /identity/v3/projects/33a805ff6bbb4403b077283546b43297/users/f4794216544c4b969910eb48c2769f3a/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:27.245577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8133f3-52a2-476f-96e4-4286ef026872 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.251556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:27.325118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8133f3-52a2-476f-96e4-4286ef026872 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.330107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dbf7a-08ff-4ca5-9cfd-3904c0f547e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.330861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dbf7a-08ff-4ca5-9cfd-3904c0f547e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.331147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dbf7a-08ff-4ca5-9cfd-3904c0f547e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.331422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dbf7a-08ff-4ca5-9cfd-3904c0f547e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.332186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dbf7a-08ff-4ca5-9cfd-3904c0f547e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.333799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dbf7a-08ff-4ca5-9cfd-3904c0f547e2 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.345068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 785/1591] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:27.346023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dbf7a-08ff-4ca5-9cfd-3904c0f547e2 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.355531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dbf7a-08ff-4ca5-9cfd-3904c0f547e2 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.359185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 807/1592] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:27 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:27.359185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4a0da-d63b-42fd-92d9-3b0fae3bf6c0 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.363910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd9219-9540-4ae1-ab58-1c0b8b2be034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.363910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd9219-9540-4ae1-ab58-1c0b8b2be034 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.363910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd9219-9540-4ae1-ab58-1c0b8b2be034 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.363910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd9219-9540-4ae1-ab58-1c0b8b2be034 admin admin] PATH_INFO: `/v3/projects/d3f0b8ede87f420b8f19359e7f4bfd24/users/1bb603a3e23943e08f817c92a68063de/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.368733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4a0da-d63b-42fd-92d9-3b0fae3bf6c0 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.373320 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a078d-4c3f-4358-a983-363bae3ea658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.373972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a078d-4c3f-4358-a983-363bae3ea658 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.374281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a078d-4c3f-4358-a983-363bae3ea658 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.374550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a078d-4c3f-4358-a983-363bae3ea658 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.375262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a078d-4c3f-4358-a983-363bae3ea658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.376915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a078d-4c3f-4358-a983-363bae3ea658 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.379792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd9219-9540-4ae1-ab58-1c0b8b2be034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f0b8ede87f420b8f19359e7f4bfd24, user_id=1bb603a3e23943e08f817c92a68063de, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.382371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd9219-9540-4ae1-ab58-1c0b8b2be034 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.387758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 808/1593] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:27.388573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a078d-4c3f-4358-a983-363bae3ea658 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.398175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a078d-4c3f-4358-a983-363bae3ea658 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.403944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92e73f-2ff8-4189-96f0-2c20601117ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.404579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92e73f-2ff8-4189-96f0-2c20601117ec admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.404865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92e73f-2ff8-4189-96f0-2c20601117ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.405158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92e73f-2ff8-4189-96f0-2c20601117ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.405862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92e73f-2ff8-4189-96f0-2c20601117ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.407437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92e73f-2ff8-4189-96f0-2c20601117ec admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.417780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 809/1594] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:27.418582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92e73f-2ff8-4189-96f0-2c20601117ec admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.428032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92e73f-2ff8-4189-96f0-2c20601117ec admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.433450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fb0da-99b3-49c1-ba0e-9eb625b0f820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.434114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb0da-99b3-49c1-ba0e-9eb625b0f820 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.434401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb0da-99b3-49c1-ba0e-9eb625b0f820 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.434668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb0da-99b3-49c1-ba0e-9eb625b0f820 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.435385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fb0da-99b3-49c1-ba0e-9eb625b0f820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.437020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fb0da-99b3-49c1-ba0e-9eb625b0f820 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.448013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 810/1595] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:27.449309 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47518fa-8088-4967-901c-aaafe50ea00a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.449651 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47518fa-8088-4967-901c-aaafe50ea00a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.449935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47518fa-8088-4967-901c-aaafe50ea00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.453587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:27.470500 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 786/1596] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:27 2022] PUT /identity/v3/projects/d3f0b8ede87f420b8f19359e7f4bfd24/users/1bb603a3e23943e08f817c92a68063de/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:27.471442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd9219-9540-4ae1-ab58-1c0b8b2be034 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.477116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f47518fa-8088-4967-901c-aaafe50ea00a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:27.479008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f47518fa-8088-4967-901c-aaafe50ea00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:27.545195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd9219-9540-4ae1-ab58-1c0b8b2be034 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.549854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 811/1597] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:27.551295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47518fa-8088-4967-901c-aaafe50ea00a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.556663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9339781-84ec-4536-8327-6b69f768da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.558405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9339781-84ec-4536-8327-6b69f768da57 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.558785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9339781-84ec-4536-8327-6b69f768da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.559282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9339781-84ec-4536-8327-6b69f768da57 admin admin] PATH_INFO: `/v3/projects/58af55f0b3154776bf2952da17dd6087/users/98a415385a3240e8aadc6ef12c249fe3/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.561098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47518fa-8088-4967-901c-aaafe50ea00a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.566753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beae023-2cc0-43d5-837b-5278e4eaed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.567854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae023-2cc0-43d5-837b-5278e4eaed38 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.568353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae023-2cc0-43d5-837b-5278e4eaed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.568817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae023-2cc0-43d5-837b-5278e4eaed38 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.569545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beae023-2cc0-43d5-837b-5278e4eaed38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.571423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beae023-2cc0-43d5-837b-5278e4eaed38 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.578946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9339781-84ec-4536-8327-6b69f768da57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58af55f0b3154776bf2952da17dd6087, user_id=98a415385a3240e8aadc6ef12c249fe3, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.581644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9339781-84ec-4536-8327-6b69f768da57 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.591634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 812/1598] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:27.592614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beae023-2cc0-43d5-837b-5278e4eaed38 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.602765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beae023-2cc0-43d5-837b-5278e4eaed38 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.607824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b83d3-f2c7-4530-b761-a91caafaf279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.608475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b83d3-f2c7-4530-b761-a91caafaf279 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.608754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b83d3-f2c7-4530-b761-a91caafaf279 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.609024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b83d3-f2c7-4530-b761-a91caafaf279 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.609769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b83d3-f2c7-4530-b761-a91caafaf279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.611342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b83d3-f2c7-4530-b761-a91caafaf279 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.625687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 813/1599] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:27.625687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b83d3-f2c7-4530-b761-a91caafaf279 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.636194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b83d3-f2c7-4530-b761-a91caafaf279 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.642310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d1df8-2a44-41e7-b93c-f529602a5fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.643001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d1df8-2a44-41e7-b93c-f529602a5fbe admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.643294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d1df8-2a44-41e7-b93c-f529602a5fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.643591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d1df8-2a44-41e7-b93c-f529602a5fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.649416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d1df8-2a44-41e7-b93c-f529602a5fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.652064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d1df8-2a44-41e7-b93c-f529602a5fbe admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.664763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 814/1600] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:27.666686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d1df8-2a44-41e7-b93c-f529602a5fbe admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.669091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 787/1601] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:27 2022] PUT /identity/v3/projects/58af55f0b3154776bf2952da17dd6087/users/98a415385a3240e8aadc6ef12c249fe3/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:27.671023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8ab17-de44-4bfe-b99a-a68d36914fc9 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.676537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8ab17-de44-4bfe-b99a-a68d36914fc9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.676537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8ab17-de44-4bfe-b99a-a68d36914fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.684180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d1df8-2a44-41e7-b93c-f529602a5fbe admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.704275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5ca8ab17-de44-4bfe-b99a-a68d36914fc9 None None] MFA Rules not processed for user `1bb603a3e23943e08f817c92a68063de`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:27.706150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5ca8ab17-de44-4bfe-b99a-a68d36914fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:27.752240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76b86-45de-4b27-b599-d81cb68402cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.753705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76b86-45de-4b27-b599-d81cb68402cf admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.754255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76b86-45de-4b27-b599-d81cb68402cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.755104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76b86-45de-4b27-b599-d81cb68402cf admin admin] PATH_INFO: `/v3/projects/f50bad5c98ca414c854f3358e2f2e0ec/users/62b8c8b994e54023933a4ff2ecf68f42/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.781200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76b86-45de-4b27-b599-d81cb68402cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50bad5c98ca414c854f3358e2f2e0ec, user_id=62b8c8b994e54023933a4ff2ecf68f42, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.786342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76b86-45de-4b27-b599-d81cb68402cf admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.797169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 788/1602] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:27.798325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8ab17-de44-4bfe-b99a-a68d36914fc9 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.855801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8ab17-de44-4bfe-b99a-a68d36914fc9 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.859460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe141bd-e825-46cd-b954-0b2f1f3e8f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.860138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe141bd-e825-46cd-b954-0b2f1f3e8f8a service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.860420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe141bd-e825-46cd-b954-0b2f1f3e8f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.860698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe141bd-e825-46cd-b954-0b2f1f3e8f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.870428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe141bd-e825-46cd-b954-0b2f1f3e8f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.871919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe141bd-e825-46cd-b954-0b2f1f3e8f8a service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.881590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 789/1603] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:27.882475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe141bd-e825-46cd-b954-0b2f1f3e8f8a service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.893599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe141bd-e825-46cd-b954-0b2f1f3e8f8a service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.899838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ceeb33-a7e1-4ade-a8dd-f8f5d0c5316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.901036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ceeb33-a7e1-4ade-a8dd-f8f5d0c5316e admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.906369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ceeb33-a7e1-4ade-a8dd-f8f5d0c5316e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.906369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ceeb33-a7e1-4ade-a8dd-f8f5d0c5316e admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.906369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ceeb33-a7e1-4ade-a8dd-f8f5d0c5316e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:27.906804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 815/1604] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:27 2022] PUT /identity/v3/projects/f50bad5c98ca414c854f3358e2f2e0ec/users/62b8c8b994e54023933a4ff2ecf68f42/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:27.906804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76b86-45de-4b27-b599-d81cb68402cf admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.906987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ceeb33-a7e1-4ade-a8dd-f8f5d0c5316e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:27.917835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 790/1605] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:27.918682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ceeb33-a7e1-4ade-a8dd-f8f5d0c5316e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:27.922023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:27.926641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:27.930570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ceeb33-a7e1-4ade-a8dd-f8f5d0c5316e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.972115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76b86-45de-4b27-b599-d81cb68402cf admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:27.976987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c576-ab7a-4888-9b84-926bf017d2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.977935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c576-ab7a-4888-9b84-926bf017d2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.978217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c576-ab7a-4888-9b84-926bf017d2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.978486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c576-ab7a-4888-9b84-926bf017d2c0 admin admin] PATH_INFO: `/v3/projects/eb43a0786f3a4716adfb902287fdeb13/users/0a925b17f9b14d149d660cb50f4a4197/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.995070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81549618-9d69-4bcb-90ed-42be97f690ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:27.996227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81549618-9d69-4bcb-90ed-42be97f690ab admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:27.996710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81549618-9d69-4bcb-90ed-42be97f690ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:27.997056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81549618-9d69-4bcb-90ed-42be97f690ab admin admin] PATH_INFO: `/v3/projects/60b5f8bc33a8482a8326b44b42fb7e4d/users/7f8a3035f5c54f3d84e2a81240a9306f/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:27.997560 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494c576-ab7a-4888-9b84-926bf017d2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb43a0786f3a4716adfb902287fdeb13, user_id=0a925b17f9b14d149d660cb50f4a4197, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.000260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494c576-ab7a-4888-9b84-926bf017d2c0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.014991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81549618-9d69-4bcb-90ed-42be97f690ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b5f8bc33a8482a8326b44b42fb7e4d, user_id=7f8a3035f5c54f3d84e2a81240a9306f, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.018269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81549618-9d69-4bcb-90ed-42be97f690ab admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.084918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 816/1606] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:27 2022] PUT /identity/v3/projects/eb43a0786f3a4716adfb902287fdeb13/users/0a925b17f9b14d149d660cb50f4a4197/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:28.086447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ebe6e-5961-4448-9960-13f07233cb99 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.086742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ebe6e-5961-4448-9960-13f07233cb99 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.087022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ebe6e-5961-4448-9960-13f07233cb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.111940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 791/1607] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:27 2022] PUT /identity/v3/projects/60b5f8bc33a8482a8326b44b42fb7e4d/users/7f8a3035f5c54f3d84e2a81240a9306f/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:28.115495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81549618-9d69-4bcb-90ed-42be97f690ab admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:28.119966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-379ebe6e-5961-4448-9960-13f07233cb99 None None] MFA Rules not processed for user `98a415385a3240e8aadc6ef12c249fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:28.121179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-379ebe6e-5961-4448-9960-13f07233cb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:28.176256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81549618-9d69-4bcb-90ed-42be97f690ab admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:28.182222 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9abe3e-97ac-43bc-80fa-86f6828de74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:28.182892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9abe3e-97ac-43bc-80fa-86f6828de74e admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.183175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9abe3e-97ac-43bc-80fa-86f6828de74e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.183431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9abe3e-97ac-43bc-80fa-86f6828de74e admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.184172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9abe3e-97ac-43bc-80fa-86f6828de74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.186584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9abe3e-97ac-43bc-80fa-86f6828de74e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.191085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 817/1608] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:28.194882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf3b7-a4e1-47f6-b622-29188462d8bd None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.195174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf3b7-a4e1-47f6-b622-29188462d8bd None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.195966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf3b7-a4e1-47f6-b622-29188462d8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.214842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-2cccf3b7-a4e1-47f6-b622-29188462d8bd None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:28.219879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2cccf3b7-a4e1-47f6-b622-29188462d8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:28.224609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 818/1609] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:28.228643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf3b7-a4e1-47f6-b622-29188462d8bd None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:28.238703 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf3b7-a4e1-47f6-b622-29188462d8bd None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:28.245405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99f12-d8b8-4f13-b639-12afe20f1daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:28.246281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99f12-d8b8-4f13-b639-12afe20f1daa admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.246563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99f12-d8b8-4f13-b639-12afe20f1daa admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.246839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99f12-d8b8-4f13-b639-12afe20f1daa admin admin] PATH_INFO: `/v3/projects/e75aed1bda3543019a99dc2559e27105/users/3c5e612ebd8848c88f658bc525e22607/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.269839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99f12-d8b8-4f13-b639-12afe20f1daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75aed1bda3543019a99dc2559e27105, user_id=3c5e612ebd8848c88f658bc525e22607, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.273461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99f12-d8b8-4f13-b639-12afe20f1daa admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.310902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 792/1610] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:28 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:28.312713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53826b9c-080d-4460-b1a8-f8435c5279c8 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.313194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53826b9c-080d-4460-b1a8-f8435c5279c8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.313630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53826b9c-080d-4460-b1a8-f8435c5279c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.331655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-53826b9c-080d-4460-b1a8-f8435c5279c8 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:28.333055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-53826b9c-080d-4460-b1a8-f8435c5279c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:28.398512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 793/1611] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:28.400524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459558-3afe-4f9c-b812-467e70b8f9ce None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.400524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459558-3afe-4f9c-b812-467e70b8f9ce None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.400884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459558-3afe-4f9c-b812-467e70b8f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.411111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 819/1612] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:28 2022] PUT /identity/v3/projects/e75aed1bda3543019a99dc2559e27105/users/3c5e612ebd8848c88f658bc525e22607/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:28.412507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99f12-d8b8-4f13-b639-12afe20f1daa admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:28.427382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-53459558-3afe-4f9c-b812-467e70b8f9ce None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:28.428944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-53459558-3afe-4f9c-b812-467e70b8f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:28.443346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:28.505612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99f12-d8b8-4f13-b639-12afe20f1daa admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:28.510081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daef8c-d930-4f18-be1e-3b9148deb55a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:28.510909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daef8c-d930-4f18-be1e-3b9148deb55a service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.511413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daef8c-d930-4f18-be1e-3b9148deb55a service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.511822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daef8c-d930-4f18-be1e-3b9148deb55a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.513711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 794/1613] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:28.514986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459558-3afe-4f9c-b812-467e70b8f9ce None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:28.528886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:28.595343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459558-3afe-4f9c-b812-467e70b8f9ce None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:28.601329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fdf23-d740-4cc6-919b-631b54df6918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:28.601329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fdf23-d740-4cc6-919b-631b54df6918 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.601329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fdf23-d740-4cc6-919b-631b54df6918 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.601329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fdf23-d740-4cc6-919b-631b54df6918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.613163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fdf23-d740-4cc6-919b-631b54df6918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.614329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daef8c-d930-4f18-be1e-3b9148deb55a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.614818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fdf23-d740-4cc6-919b-631b54df6918 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.616163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daef8c-d930-4f18-be1e-3b9148deb55a service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.630031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 820/1614] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:28.630031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daef8c-d930-4f18-be1e-3b9148deb55a service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:28.636058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 795/1615] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:28.636913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fdf23-d740-4cc6-919b-631b54df6918 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:28.644970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daef8c-d930-4f18-be1e-3b9148deb55a service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:28.651802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c12a50-cf78-4736-846e-db8eef036c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:28.652985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c12a50-cf78-4736-846e-db8eef036c25 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.653729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c12a50-cf78-4736-846e-db8eef036c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.653729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c12a50-cf78-4736-846e-db8eef036c25 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.654599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c12a50-cf78-4736-846e-db8eef036c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.656939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fdf23-d740-4cc6-919b-631b54df6918 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:28.657137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c12a50-cf78-4736-846e-db8eef036c25 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.669157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb580a-c2d0-49cc-bd67-52def208c5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:28.669821 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb580a-c2d0-49cc-bd67-52def208c5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.670104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb580a-c2d0-49cc-bd67-52def208c5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.670380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb580a-c2d0-49cc-bd67-52def208c5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.688582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb580a-c2d0-49cc-bd67-52def208c5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.690122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb580a-c2d0-49cc-bd67-52def208c5d4 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.713143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 796/1616] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:28.713143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae851-947f-49e3-befc-fe007eb3b9c2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.713143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae851-947f-49e3-befc-fe007eb3b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.713143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae851-947f-49e3-befc-fe007eb3b9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.749747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e98ae851-947f-49e3-befc-fe007eb3b9c2 None None] MFA Rules not processed for user `3c5e612ebd8848c88f658bc525e22607`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:28.751714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e98ae851-947f-49e3-befc-fe007eb3b9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:28.808463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 821/1617] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:28 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:28.809552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c12a50-cf78-4736-846e-db8eef036c25 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:28.840232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c12a50-cf78-4736-846e-db8eef036c25 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:28.856395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff350b-5c5e-4e73-95ed-ceadc80b5187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:28.859511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff350b-5c5e-4e73-95ed-ceadc80b5187 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.861113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff350b-5c5e-4e73-95ed-ceadc80b5187 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.862168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff350b-5c5e-4e73-95ed-ceadc80b5187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.889325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff350b-5c5e-4e73-95ed-ceadc80b5187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.893183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff350b-5c5e-4e73-95ed-ceadc80b5187 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.920196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 797/1618] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:28.923045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ae851-947f-49e3-befc-fe007eb3b9c2 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:28.923453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 822/1619] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:28.956280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ae851-947f-49e3-befc-fe007eb3b9c2 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:28.960262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364de68-b081-4d5c-982c-8a4ed3fe51b5 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.960262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364de68-b081-4d5c-982c-8a4ed3fe51b5 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.960832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364de68-b081-4d5c-982c-8a4ed3fe51b5 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.962687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 823/1620] 10.222.0.93 () {54 vars in 961 bytes} [Thu May 26 17:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:04:28.970051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54758d-9bf8-43c9-8a37-e682bc72fadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:28.971063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54758d-9bf8-43c9-8a37-e682bc72fadf admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.971642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54758d-9bf8-43c9-8a37-e682bc72fadf admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.972095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54758d-9bf8-43c9-8a37-e682bc72fadf admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.973000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54758d-9bf8-43c9-8a37-e682bc72fadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:28.974932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54758d-9bf8-43c9-8a37-e682bc72fadf admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:28.977308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971aac-02ca-474d-837c-f58fa1a54835 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:28.978361 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971aac-02ca-474d-837c-f58fa1a54835 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:28.978856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971aac-02ca-474d-837c-f58fa1a54835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:28.989495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 798/1621] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:28.995126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54758d-9bf8-43c9-8a37-e682bc72fadf admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:29.016196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9e971aac-02ca-474d-837c-f58fa1a54835 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:29.017595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9e971aac-02ca-474d-837c-f58fa1a54835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:29.017975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54758d-9bf8-43c9-8a37-e682bc72fadf admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:29.024095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246088-9a21-4d9f-8049-45b1ec0d26ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:29.025135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246088-9a21-4d9f-8049-45b1ec0d26ca admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:29.025418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246088-9a21-4d9f-8049-45b1ec0d26ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:29.025693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246088-9a21-4d9f-8049-45b1ec0d26ca admin admin] PATH_INFO: `/v3/projects/7902f13f97094fa1bd8623d7877015e3/users/a9720115904b4d5986208bbc9bfd22f4/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:29.076414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246088-9a21-4d9f-8049-45b1ec0d26ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7902f13f97094fa1bd8623d7877015e3, user_id=a9720115904b4d5986208bbc9bfd22f4, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:29.082888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246088-9a21-4d9f-8049-45b1ec0d26ca admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:29.143974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 824/1622] 10.222.0.93 () {58 vars in 1058 bytes} [Thu May 26 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:29.163236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971aac-02ca-474d-837c-f58fa1a54835 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:29.170754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971aac-02ca-474d-837c-f58fa1a54835 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:29.179169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d01e3c-c96d-4629-8774-465a4eaffbfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:29.179882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d01e3c-c96d-4629-8774-465a4eaffbfe service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:29.180534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d01e3c-c96d-4629-8774-465a4eaffbfe service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:29.180844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d01e3c-c96d-4629-8774-465a4eaffbfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:29.184884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:29.191157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 799/1623] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:28 2022] PUT /identity/v3/projects/7902f13f97094fa1bd8623d7877015e3/users/a9720115904b4d5986208bbc9bfd22f4/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:29.195506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246088-9a21-4d9f-8049-45b1ec0d26ca admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:29.195657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d01e3c-c96d-4629-8774-465a4eaffbfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:29.198075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d01e3c-c96d-4629-8774-465a4eaffbfe service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:29.211107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 825/1624] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:04:29.279403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246088-9a21-4d9f-8049-45b1ec0d26ca admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:29.300164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a34402-0b73-4786-a0ca-38d9eb9da184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:29.300929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a34402-0b73-4786-a0ca-38d9eb9da184 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:29.302417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a34402-0b73-4786-a0ca-38d9eb9da184 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:29.304048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a34402-0b73-4786-a0ca-38d9eb9da184 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:29.305874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a34402-0b73-4786-a0ca-38d9eb9da184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:29.310612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a34402-0b73-4786-a0ca-38d9eb9da184 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:29.327546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 800/1625] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:29.331737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d01e3c-c96d-4629-8774-465a4eaffbfe service nova] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:29.362001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d01e3c-c96d-4629-8774-465a4eaffbfe service nova] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:29.370198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c11942-9577-46b5-ad26-f1eaaac179bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:29.371397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c11942-9577-46b5-ad26-f1eaaac179bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:29.371943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c11942-9577-46b5-ad26-f1eaaac179bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:29.372348 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c11942-9577-46b5-ad26-f1eaaac179bb admin admin] PATH_INFO: `/v3/projects/7902f13f97094fa1bd8623d7877015e3/users/a9720115904b4d5986208bbc9bfd22f4/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:29.376216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c11942-9577-46b5-ad26-f1eaaac179bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7902f13f97094fa1bd8623d7877015e3, user_id=a9720115904b4d5986208bbc9bfd22f4, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:29.379432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c11942-9577-46b5-ad26-f1eaaac179bb admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:29.403911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 826/1626] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:29 2022] PUT /identity/v3/projects/7902f13f97094fa1bd8623d7877015e3/users/a9720115904b4d5986208bbc9bfd22f4/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:29.406030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee228ca6-96b1-4791-9156-d1e878fdbc91 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:29.406426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee228ca6-96b1-4791-9156-d1e878fdbc91 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:29.406851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee228ca6-96b1-4791-9156-d1e878fdbc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:29.463818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ee228ca6-96b1-4791-9156-d1e878fdbc91 None None] MFA Rules not processed for user `a9720115904b4d5986208bbc9bfd22f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:29.465315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ee228ca6-96b1-4791-9156-d1e878fdbc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:29.585123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 801/1627] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:29.592302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebed7b-d274-4a21-bfe2-325ec465c8fc None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:29.592302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebed7b-d274-4a21-bfe2-325ec465c8fc None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:29.592302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebed7b-d274-4a21-bfe2-325ec465c8fc None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:29.594777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 827/1628] 10.222.0.93 () {54 vars in 912 bytes} [Thu May 26 17:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:04:29.600854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28feef5-7b50-40b7-9573-a742b9352a88 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:29.602547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28feef5-7b50-40b7-9573-a742b9352a88 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:29.603394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28feef5-7b50-40b7-9573-a742b9352a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:29.605103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebed7b-d274-4a21-bfe2-325ec465c8fc None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:29.642602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c28feef5-7b50-40b7-9573-a742b9352a88 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:29.643857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c28feef5-7b50-40b7-9573-a742b9352a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:29.720757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:29.748279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebed7b-d274-4a21-bfe2-325ec465c8fc None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:29.753481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d94154-21d6-41b8-ab10-ef640d9da577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:29.755595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94154-21d6-41b8-ab10-ef640d9da577 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:29.756754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94154-21d6-41b8-ab10-ef640d9da577 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:29.757312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94154-21d6-41b8-ab10-ef640d9da577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:29.775722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d94154-21d6-41b8-ab10-ef640d9da577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:29.783412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d94154-21d6-41b8-ab10-ef640d9da577 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:29.805279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 828/1630] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:29.805415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 802/1630] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:04:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:30.015273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d94154-21d6-41b8-ab10-ef640d9da577 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:30.026117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d94154-21d6-41b8-ab10-ef640d9da577 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:30.266675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912c987-82aa-4de6-a21b-3da5cf9b01d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:30.266675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c987-82aa-4de6-a21b-3da5cf9b01d2 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:30.266675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c987-82aa-4de6-a21b-3da5cf9b01d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:30.266675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c987-82aa-4de6-a21b-3da5cf9b01d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:30.269677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912c987-82aa-4de6-a21b-3da5cf9b01d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:30.269677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912c987-82aa-4de6-a21b-3da5cf9b01d2 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:30.269677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 829/1631] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:32.051174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28feef5-7b50-40b7-9573-a742b9352a88 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:32.076641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:32.190339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70e09-639a-469d-958e-a86057c1a2fb None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:32.192648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70e09-639a-469d-958e-a86057c1a2fb None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:32.193372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70e09-639a-469d-958e-a86057c1a2fb None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:32.195219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 830/1632] 10.222.0.93 () {54 vars in 961 bytes} [Thu May 26 17:04:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:04:32.206757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c7c57-6923-476d-b94a-7974057b3873 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:32.207552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c7c57-6923-476d-b94a-7974057b3873 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:32.210004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c7c57-6923-476d-b94a-7974057b3873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:32.249999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-771c7c57-6923-476d-b94a-7974057b3873 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:32.251875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28feef5-7b50-40b7-9573-a742b9352a88 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:32.252306 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-771c7c57-6923-476d-b94a-7974057b3873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:32.257495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:32.259501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:32.260027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:32.260309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] PATH_INFO: `/v3/users/1bb603a3e23943e08f817c92a68063de` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:32.261708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb603a3e23943e08f817c92a68063de)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:32.262946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: WARNING py.warnings [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:04:32.262946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: warnings.warn(msg) May 26 17:04:32.262946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: May 26 17:04:32.264768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:32.267597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 831/1633] 10.222.0.93 () {58 vars in 1058 bytes} [Thu May 26 17:04:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:32.278858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977982b8-e372-4f7d-b276-5635cf2d032e None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:32.279142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977982b8-e372-4f7d-b276-5635cf2d032e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:32.279418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977982b8-e372-4f7d-b276-5635cf2d032e None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:32.281232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 832/1634] 10.222.0.93 () {54 vars in 912 bytes} [Thu May 26 17:04:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:04:32.286635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61b9e-2176-4ab3-b76e-b633e09d67da None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:32.287169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61b9e-2176-4ab3-b76e-b633e09d67da None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:32.287637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61b9e-2176-4ab3-b76e-b633e09d67da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:32.307853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-21a61b9e-2176-4ab3-b76e-b633e09d67da None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:32.309566 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-21a61b9e-2176-4ab3-b76e-b633e09d67da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:32.323040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 833/1635] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:04:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:32.336431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61b9e-2176-4ab3-b76e-b633e09d67da None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:32.349391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61b9e-2176-4ab3-b76e-b633e09d67da None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:32.354588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea011547-b68a-406e-8ac3-a01f6c038772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:32.355451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea011547-b68a-406e-8ac3-a01f6c038772 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:32.355974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea011547-b68a-406e-8ac3-a01f6c038772 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:32.356241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea011547-b68a-406e-8ac3-a01f6c038772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:32.367342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea011547-b68a-406e-8ac3-a01f6c038772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:32.369008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea011547-b68a-406e-8ac3-a01f6c038772 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:32.402866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 834/1636] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:04:32.554518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb603a3e23943e08f817c92a68063de'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:32.579887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb603a3e23943e08f817c92a68063de'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:32.580444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb603a3e23943e08f817c92a68063de'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:32.613435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb603a3e23943e08f817c92a68063de'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:32.615147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dd9b2cef-f524-4cc0-8eac-317c3ca10edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb603a3e23943e08f817c92a68063de'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:32.618405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72993869-1983-4dc9-a256-193c8a4a6032 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:32.620075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72993869-1983-4dc9-a256-193c8a4a6032 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:32.620552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72993869-1983-4dc9-a256-193c8a4a6032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:32.658907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-72993869-1983-4dc9-a256-193c8a4a6032 None None] MFA Rules not processed for user `0a925b17f9b14d149d660cb50f4a4197`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:32.660342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-72993869-1983-4dc9-a256-193c8a4a6032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:32.762193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 803/1637] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:04:32 2022] DELETE /identity/v3/users/1bb603a3e23943e08f817c92a68063de => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:32.763902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf86e5f-df17-4346-82ee-1893658be005 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:32.764216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf86e5f-df17-4346-82ee-1893658be005 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:32.764689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf86e5f-df17-4346-82ee-1893658be005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:32.845392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5bf86e5f-df17-4346-82ee-1893658be005 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:32.847416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5bf86e5f-df17-4346-82ee-1893658be005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:32.851596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 835/1638] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:32.868375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8f03d-419b-4b0a-83f0-79108534c259 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:32.868700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8f03d-419b-4b0a-83f0-79108534c259 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:32.868985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8f03d-419b-4b0a-83f0-79108534c259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:32.906169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-46d8f03d-419b-4b0a-83f0-79108534c259 None None] MFA Rules not processed for user `0a925b17f9b14d149d660cb50f4a4197`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:32.907870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-46d8f03d-419b-4b0a-83f0-79108534c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:33.016726 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 804/1639] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:33.078830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 836/1640] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:33.089828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf86e5f-df17-4346-82ee-1893658be005 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:33.092369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8f03d-419b-4b0a-83f0-79108534c259 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:33.093100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5bf86e5f-df17-4346-82ee-1893658be005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:33.093855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-46d8f03d-419b-4b0a-83f0-79108534c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:33.146215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:33.177989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf86e5f-df17-4346-82ee-1893658be005 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:33.184293 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae789b7-543f-4963-b3f1-799490f90141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:33.185578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae789b7-543f-4963-b3f1-799490f90141 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:33.186228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae789b7-543f-4963-b3f1-799490f90141 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:33.186715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae789b7-543f-4963-b3f1-799490f90141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:33.192012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:33.199067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae789b7-543f-4963-b3f1-799490f90141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:33.201187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae789b7-543f-4963-b3f1-799490f90141 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:33.217200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 805/1641] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:33.256016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8f03d-419b-4b0a-83f0-79108534c259 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:33.267745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48cfc4-4711-44e6-b7ab-f4c9ed16acc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:33.271897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48cfc4-4711-44e6-b7ab-f4c9ed16acc2 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:33.273726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48cfc4-4711-44e6-b7ab-f4c9ed16acc2 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:33.274832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48cfc4-4711-44e6-b7ab-f4c9ed16acc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:33.295252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48cfc4-4711-44e6-b7ab-f4c9ed16acc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:33.297220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48cfc4-4711-44e6-b7ab-f4c9ed16acc2 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:33.325505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 837/1642] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:34.192476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45806a-06ab-404d-a12c-96f228c66dab None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:34.194147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45806a-06ab-404d-a12c-96f228c66dab None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:34.195339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45806a-06ab-404d-a12c-96f228c66dab None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:34.197236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 806/1643] 10.222.0.93 () {54 vars in 912 bytes} [Thu May 26 17:04:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:04:34.205243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffead9-a05a-4160-92e0-ed84a89a210f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:34.206321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffead9-a05a-4160-92e0-ed84a89a210f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:34.206841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffead9-a05a-4160-92e0-ed84a89a210f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:34.326720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-08ffead9-a05a-4160-92e0-ed84a89a210f None None] MFA Rules not processed for user `8fee665c10364944a8162548f91a431e`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:34.326720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-08ffead9-a05a-4160-92e0-ed84a89a210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:34.342653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 838/1644] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:04:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:34.375168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45806a-06ab-404d-a12c-96f228c66dab None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:34.397880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45806a-06ab-404d-a12c-96f228c66dab None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:34.412560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaf389-e8fc-4455-b68c-87ae9af5793c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:34.413277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaf389-e8fc-4455-b68c-87ae9af5793c service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:34.413565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaf389-e8fc-4455-b68c-87ae9af5793c service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:34.413844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaf389-e8fc-4455-b68c-87ae9af5793c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:34.432780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaf389-e8fc-4455-b68c-87ae9af5793c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:34.433289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaf389-e8fc-4455-b68c-87ae9af5793c service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:34.453515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 807/1645] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:34.853176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffead9-a05a-4160-92e0-ed84a89a210f None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:34.855497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-08ffead9-a05a-4160-92e0-ed84a89a210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:34.906239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffead9-a05a-4160-92e0-ed84a89a210f None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:34.916765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:34.921265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:34.922415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:34.923393 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] PATH_INFO: `/v3/projects/d3f0b8ede87f420b8f19359e7f4bfd24` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:34.939792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f0b8ede87f420b8f19359e7f4bfd24)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:34.948350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: WARNING py.warnings [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:04:34.948350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: warnings.warn(msg) May 26 17:04:34.948350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: May 26 17:04:34.948350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:35.244981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f0b8ede87f420b8f19359e7f4bfd24', 'request_id': 'req-8755dddc-8641-4d7d-af5e-180dd9e869bb'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:35.287167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f0b8ede87f420b8f19359e7f4bfd24', 'request_id': 'req-8755dddc-8641-4d7d-af5e-180dd9e869bb'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:35.332307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f0b8ede87f420b8f19359e7f4bfd24', 'request_id': 'req-8755dddc-8641-4d7d-af5e-180dd9e869bb'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:35.398269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaf389-e8fc-4455-b68c-87ae9af5793c service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:35.399173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3afaf389-e8fc-4455-b68c-87ae9af5793c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:35.443125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaf389-e8fc-4455-b68c-87ae9af5793c service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:35.481381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] The token cache is being invalidate because project d3f0b8ede87f420b8f19359e7f4bfd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:04:35.481613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:35.482853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:35.492697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 839/1646] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:04:34 2022] DELETE /identity/v3/projects/d3f0b8ede87f420b8f19359e7f4bfd24 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:35.497710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:35.506834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:35.680456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:35.682160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:35.682576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:35.682984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] PATH_INFO: `/v3/users/3c5e612ebd8848c88f658bc525e22607` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:35.685970 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5e612ebd8848c88f658bc525e22607)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:35.688184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:35.750817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755dddc-8641-4d7d-af5e-180dd9e869bb admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:35.761117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:35.762082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:35.762372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:35.763393 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] PATH_INFO: `/v3/users/a9720115904b4d5986208bbc9bfd22f4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:35.770645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9720115904b4d5986208bbc9bfd22f4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:35.774973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:35.959291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5e612ebd8848c88f658bc525e22607'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:35.993036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5e612ebd8848c88f658bc525e22607'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:35.995139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5e612ebd8848c88f658bc525e22607'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:36.018187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:36.045208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9720115904b4d5986208bbc9bfd22f4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:36.094249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5e612ebd8848c88f658bc525e22607'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:36.097785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b52f845-80e5-4f01-84a6-21d0e194e9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5e612ebd8848c88f658bc525e22607'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:36.188642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9720115904b4d5986208bbc9bfd22f4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:36.203900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9720115904b4d5986208bbc9bfd22f4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:36.240181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9720115904b4d5986208bbc9bfd22f4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:36.246354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4e41c5e0-990b-4b2a-aac6-c54b04c0862c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9720115904b4d5986208bbc9bfd22f4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:36.269080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 840/1647] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:04:35 2022] DELETE /identity/v3/users/a9720115904b4d5986208bbc9bfd22f4 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:36.275948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad9660-3555-4aca-b43e-6215bd7ad1c3 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:36.277365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad9660-3555-4aca-b43e-6215bd7ad1c3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:36.278037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad9660-3555-4aca-b43e-6215bd7ad1c3 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:36.281597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 841/1648] 10.222.0.93 () {54 vars in 960 bytes} [Thu May 26 17:04:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:04:36.300500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77801c5-178f-44c4-b193-6e73d8eae862 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:36.302657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77801c5-178f-44c4-b193-6e73d8eae862 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:36.303177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77801c5-178f-44c4-b193-6e73d8eae862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:36.332638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 808/1649] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:04:35 2022] DELETE /identity/v3/users/3c5e612ebd8848c88f658bc525e22607 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:36.337829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7fb11-9a2f-4ba0-9207-91503515f0b0 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:36.338125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7fb11-9a2f-4ba0-9207-91503515f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:36.338416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7fb11-9a2f-4ba0-9207-91503515f0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:36.345578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f77801c5-178f-44c4-b193-6e73d8eae862 None None] MFA Rules not processed for user `bae184afff284dcaa228859902e92191`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:36.347490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f77801c5-178f-44c4-b193-6e73d8eae862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:36.400113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ebf7fb11-9a2f-4ba0-9207-91503515f0b0 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:36.405300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ebf7fb11-9a2f-4ba0-9207-91503515f0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:36.512749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:36.562752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 842/1650] 10.222.0.93 () {58 vars in 1057 bytes} [Thu May 26 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:36.601116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 809/1651] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:36.601613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77801c5-178f-44c4-b193-6e73d8eae862 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:36.637496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77801c5-178f-44c4-b193-6e73d8eae862 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:36.662915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:36.664568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:36.664965 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:36.665702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:36.667309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7fb11-9a2f-4ba0-9207-91503515f0b0 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:36.669125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ebf7fb11-9a2f-4ba0-9207-91503515f0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:36.682185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:36.756010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:36.759224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:36.779216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 843/1652] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:36.939425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7fb11-9a2f-4ba0-9207-91503515f0b0 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:36.956917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982a924-6461-46e0-8434-a594b3ab0b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:36.957621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982a924-6461-46e0-8434-a594b3ab0b62 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:36.957908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982a924-6461-46e0-8434-a594b3ab0b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:36.958194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982a924-6461-46e0-8434-a594b3ab0b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:36.988901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982a924-6461-46e0-8434-a594b3ab0b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:36.993740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982a924-6461-46e0-8434-a594b3ab0b62 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:37.028089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 810/1653] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:04:37.658997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:37.661275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:37.713625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67678e54-5c9a-432f-bae5-01c853b4a1e8 service placement] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:37.744432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:37.745477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:37.745768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:37.745768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] PATH_INFO: `/v3/projects/7902f13f97094fa1bd8623d7877015e3` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:37.748382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7902f13f97094fa1bd8623d7877015e3)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:37.750402 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:37.945215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7902f13f97094fa1bd8623d7877015e3', 'request_id': 'req-ac14734c-d951-4fa9-98bd-5165ade0fe30'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:37.964603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7902f13f97094fa1bd8623d7877015e3', 'request_id': 'req-ac14734c-d951-4fa9-98bd-5165ade0fe30'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:37.971801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7902f13f97094fa1bd8623d7877015e3', 'request_id': 'req-ac14734c-d951-4fa9-98bd-5165ade0fe30'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:38.115836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] The token cache is being invalidate because project 7902f13f97094fa1bd8623d7877015e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:04:38.116193 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:38.117063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ac14734c-d951-4fa9-98bd-5165ade0fe30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:38.119295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 844/1654] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:04:37 2022] DELETE /identity/v3/projects/7902f13f97094fa1bd8623d7877015e3 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:38.124010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39348df-4524-4e7e-9233-557e707e714a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:38.124560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39348df-4524-4e7e-9233-557e707e714a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:38.124560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39348df-4524-4e7e-9233-557e707e714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:38.160166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f39348df-4524-4e7e-9233-557e707e714a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:38.161683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f39348df-4524-4e7e-9233-557e707e714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:38.289216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 811/1655] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:38.297002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928eb5f-1092-48a2-b10a-c87dec656720 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:38.297537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928eb5f-1092-48a2-b10a-c87dec656720 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:38.297952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928eb5f-1092-48a2-b10a-c87dec656720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:38.336710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4928eb5f-1092-48a2-b10a-c87dec656720 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:38.338004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4928eb5f-1092-48a2-b10a-c87dec656720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:38.364945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 845/1656] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:38.374161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39348df-4524-4e7e-9233-557e707e714a None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:38.405786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39348df-4524-4e7e-9233-557e707e714a None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:38.416644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd56e-d91f-4799-990f-70da844ffbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:38.419523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd56e-d91f-4799-990f-70da844ffbff admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:38.419523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd56e-d91f-4799-990f-70da844ffbff admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:38.419523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd56e-d91f-4799-990f-70da844ffbff admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:38.419523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd56e-d91f-4799-990f-70da844ffbff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:38.419523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd56e-d91f-4799-990f-70da844ffbff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:38.436655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd56e-d91f-4799-990f-70da844ffbff admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:38.467471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928eb5f-1092-48a2-b10a-c87dec656720 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:38.477622 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 812/1657] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:38.484760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928eb5f-1092-48a2-b10a-c87dec656720 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:38.497513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086759-e873-4bed-8bfa-bf2fbeaf4afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:38.498372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086759-e873-4bed-8bfa-bf2fbeaf4afa admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:38.498799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086759-e873-4bed-8bfa-bf2fbeaf4afa admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:38.499210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086759-e873-4bed-8bfa-bf2fbeaf4afa admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:38.500315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086759-e873-4bed-8bfa-bf2fbeaf4afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:38.502215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086759-e873-4bed-8bfa-bf2fbeaf4afa admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:38.626973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd56e-d91f-4799-990f-70da844ffbff admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:38.647241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 846/1658] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:38 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:38.652648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd56e-d91f-4799-990f-70da844ffbff admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:38.917832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf2a1b-044e-4381-a245-381c8c9a876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:38.919129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf2a1b-044e-4381-a245-381c8c9a876d admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:38.919673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf2a1b-044e-4381-a245-381c8c9a876d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:38.920188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf2a1b-044e-4381-a245-381c8c9a876d admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:38.935826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf2a1b-044e-4381-a245-381c8c9a876d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:38.945758 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf2a1b-044e-4381-a245-381c8c9a876d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:39.091342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:39.098288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 813/1659] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:38 2022] POST /identity/v3/users => generated 283 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:04:39.101152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086759-e873-4bed-8bfa-bf2fbeaf4afa admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:39.113414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086759-e873-4bed-8bfa-bf2fbeaf4afa admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:39.142352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a7e22-f59b-4c60-9501-fc723a5609ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:39.143048 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7e22-f59b-4c60-9501-fc723a5609ff admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:39.143497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7e22-f59b-4c60-9501-fc723a5609ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:39.143937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7e22-f59b-4c60-9501-fc723a5609ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:39.145011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a7e22-f59b-4c60-9501-fc723a5609ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:39.150494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a7e22-f59b-4c60-9501-fc723a5609ff admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:39.187583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 847/1660] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:39.191713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf2a1b-044e-4381-a245-381c8c9a876d admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:39.209754 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf2a1b-044e-4381-a245-381c8c9a876d admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:39.224809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a93ca1-2ecc-4f53-aec0-87d17ee30ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:39.225498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a93ca1-2ecc-4f53-aec0-87d17ee30ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:39.225812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a93ca1-2ecc-4f53-aec0-87d17ee30ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:39.232875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a93ca1-2ecc-4f53-aec0-87d17ee30ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:39.233932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a93ca1-2ecc-4f53-aec0-87d17ee30ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:39.235431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a93ca1-2ecc-4f53-aec0-87d17ee30ff9 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:39.272412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 814/1661] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:39.276704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a7e22-f59b-4c60-9501-fc723a5609ff admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:39.293461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a7e22-f59b-4c60-9501-fc723a5609ff admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:39.313157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6178039-8eb2-4ebd-b398-172ccdd2942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:39.314066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178039-8eb2-4ebd-b398-172ccdd2942f admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:39.314348 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178039-8eb2-4ebd-b398-172ccdd2942f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:39.328715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178039-8eb2-4ebd-b398-172ccdd2942f admin admin] PATH_INFO: `/v3/projects/621e2c45022c489f956bdd94f99f0afa/users/7dbf85904bd140b8ba126b1ce066eef3/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:39.342868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:39.377903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6178039-8eb2-4ebd-b398-172ccdd2942f admin admin] RBAC: Authorizing `identity:create_grant(project_id=621e2c45022c489f956bdd94f99f0afa, user_id=7dbf85904bd140b8ba126b1ce066eef3, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:39.381832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6178039-8eb2-4ebd-b398-172ccdd2942f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:39.422871 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418b17d-1d13-4196-8701-200403180bd6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:39.423388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418b17d-1d13-4196-8701-200403180bd6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:39.423827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418b17d-1d13-4196-8701-200403180bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:39.465548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 848/1662] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:39 2022] PUT /identity/v3/projects/621e2c45022c489f956bdd94f99f0afa/users/7dbf85904bd140b8ba126b1ce066eef3/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:39.477507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054918a8-e938-4e4d-883f-bc916a4246fd None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:39.478851 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054918a8-e938-4e4d-883f-bc916a4246fd None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:39.479311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054918a8-e938-4e4d-883f-bc916a4246fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:39.491967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a418b17d-1d13-4196-8701-200403180bd6 None None] MFA Rules not processed for user `bc0e583fb8414bde82872ccc4726e5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:39.494178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a418b17d-1d13-4196-8701-200403180bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:39.715421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 815/1663] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:39.749042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418b17d-1d13-4196-8701-200403180bd6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:39.757890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a418b17d-1d13-4196-8701-200403180bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:39.836540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-054918a8-e938-4e4d-883f-bc916a4246fd None None] MFA Rules not processed for user `7dbf85904bd140b8ba126b1ce066eef3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:39.843860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-054918a8-e938-4e4d-883f-bc916a4246fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:39.865360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418b17d-1d13-4196-8701-200403180bd6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:39.881145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:39.882038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:39.882324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:39.882826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] PATH_INFO: `/v3/projects/e75aed1bda3543019a99dc2559e27105` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:39.884819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75aed1bda3543019a99dc2559e27105)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:39.889938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:40.050726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 849/1664] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 572 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:40.050726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054918a8-e938-4e4d-883f-bc916a4246fd None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:40.076633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-054918a8-e938-4e4d-883f-bc916a4246fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:40.101379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75aed1bda3543019a99dc2559e27105', 'request_id': 'req-ace4a787-e910-4f9b-a602-d78809d50557'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:40.105652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75aed1bda3543019a99dc2559e27105', 'request_id': 'req-ace4a787-e910-4f9b-a602-d78809d50557'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:40.119280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75aed1bda3543019a99dc2559e27105', 'request_id': 'req-ace4a787-e910-4f9b-a602-d78809d50557'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:40.239221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] The token cache is being invalidate because project e75aed1bda3543019a99dc2559e27105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:04:40.240244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:40.241861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:40.245586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 816/1665] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:04:39 2022] DELETE /identity/v3/projects/e75aed1bda3543019a99dc2559e27105 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:40.246607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:40.255706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:40.363991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054918a8-e938-4e4d-883f-bc916a4246fd None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:40.463546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4a787-e910-4f9b-a602-d78809d50557 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:40.477929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1f43c-a75a-44e8-b644-382a68f2b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:40.478718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f43c-a75a-44e8-b644-382a68f2b17f admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:40.479250 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f43c-a75a-44e8-b644-382a68f2b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:40.479746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f43c-a75a-44e8-b644-382a68f2b17f admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:40.480853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1f43c-a75a-44e8-b644-382a68f2b17f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:40.486626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1f43c-a75a-44e8-b644-382a68f2b17f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:40.507601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff593-06ef-4b05-818d-154f1cc1d3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:40.508528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff593-06ef-4b05-818d-154f1cc1d3e3 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:40.508935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff593-06ef-4b05-818d-154f1cc1d3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:40.509875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff593-06ef-4b05-818d-154f1cc1d3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:40.512396 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-86cff593-06ef-4b05-818d-154f1cc1d3e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:40.630872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 817/1666] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:40 2022] POST /identity/v3/projects => generated 363 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:40.630872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032881fa-5e6b-494c-a726-3accf66a617b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:40.630872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032881fa-5e6b-494c-a726-3accf66a617b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:40.633677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032881fa-5e6b-494c-a726-3accf66a617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:40.656997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:40.689132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-032881fa-5e6b-494c-a726-3accf66a617b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:40.692211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-032881fa-5e6b-494c-a726-3accf66a617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:40.716620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff593-06ef-4b05-818d-154f1cc1d3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:40.720712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff593-06ef-4b05-818d-154f1cc1d3e3 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:40.742699 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 850/1667] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:40.748213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff593-06ef-4b05-818d-154f1cc1d3e3 service nova] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:40.766519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff593-06ef-4b05-818d-154f1cc1d3e3 service nova] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:40.841700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 818/1668] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:40.850407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e9625-4f82-45b2-9cb3-add654e08f30 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:40.853478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e9625-4f82-45b2-9cb3-add654e08f30 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:40.853478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e9625-4f82-45b2-9cb3-add654e08f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:40.894436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-960e9625-4f82-45b2-9cb3-add654e08f30 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:40.902572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-960e9625-4f82-45b2-9cb3-add654e08f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:40.902806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:40.918172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed5f55-0bbd-46e0-bcba-2abc4bc4bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:40.920256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed5f55-0bbd-46e0-bcba-2abc4bc4bae3 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:40.920947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed5f55-0bbd-46e0-bcba-2abc4bc4bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:40.922265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed5f55-0bbd-46e0-bcba-2abc4bc4bae3 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:40.925208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed5f55-0bbd-46e0-bcba-2abc4bc4bae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:40.925765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 819/1669] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:40.928180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed5f55-0bbd-46e0-bcba-2abc4bc4bae3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:40.929519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e9625-4f82-45b2-9cb3-add654e08f30 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:40.949345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e9625-4f82-45b2-9cb3-add654e08f30 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:40.957994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165433cb-4152-427d-b020-0867dbdf1e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:40.958886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165433cb-4152-427d-b020-0867dbdf1e6c admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:40.959308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165433cb-4152-427d-b020-0867dbdf1e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:40.959675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165433cb-4152-427d-b020-0867dbdf1e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:40.960752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165433cb-4152-427d-b020-0867dbdf1e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:40.961158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165433cb-4152-427d-b020-0867dbdf1e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:40.964065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165433cb-4152-427d-b020-0867dbdf1e6c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:40.986522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 820/1670] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:40.999434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165433cb-4152-427d-b020-0867dbdf1e6c admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:41.017322 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165433cb-4152-427d-b020-0867dbdf1e6c admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:41.036091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d41135-7fa7-4613-bdc5-770ee210a187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:41.044642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41135-7fa7-4613-bdc5-770ee210a187 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:41.044642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41135-7fa7-4613-bdc5-770ee210a187 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:41.044642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41135-7fa7-4613-bdc5-770ee210a187 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:41.044886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 851/1671] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:40 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:41.044957 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d41135-7fa7-4613-bdc5-770ee210a187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:41.045995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed5f55-0bbd-46e0-bcba-2abc4bc4bae3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:41.055147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d41135-7fa7-4613-bdc5-770ee210a187 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:41.073633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed5f55-0bbd-46e0-bcba-2abc4bc4bae3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:41.093482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac887c0-f078-42f5-909c-d1d1dad408d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:41.093482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac887c0-f078-42f5-909c-d1d1dad408d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:41.093482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac887c0-f078-42f5-909c-d1d1dad408d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:41.093893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac887c0-f078-42f5-909c-d1d1dad408d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:41.094425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac887c0-f078-42f5-909c-d1d1dad408d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:41.107236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac887c0-f078-42f5-909c-d1d1dad408d6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:41.131435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 852/1672] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:04:41.132864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac887c0-f078-42f5-909c-d1d1dad408d6 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:41.147295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac887c0-f078-42f5-909c-d1d1dad408d6 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:41.156346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6ff5f-45ae-4fe7-b8b2-e18dd8755c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:41.163585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6ff5f-45ae-4fe7-b8b2-e18dd8755c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:41.163585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6ff5f-45ae-4fe7-b8b2-e18dd8755c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:41.163585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6ff5f-45ae-4fe7-b8b2-e18dd8755c24 admin admin] PATH_INFO: `/v3/projects/36364b26f7a347bfa5808ab0437c452a/users/fa69836f35db4ccfac1320d4dcd8607e/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:41.190422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6ff5f-45ae-4fe7-b8b2-e18dd8755c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36364b26f7a347bfa5808ab0437c452a, user_id=fa69836f35db4ccfac1320d4dcd8607e, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:41.195018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6ff5f-45ae-4fe7-b8b2-e18dd8755c24 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:41.250089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 821/1673] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:40 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:41.256175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d41135-7fa7-4613-bdc5-770ee210a187 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:41.316753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 853/1674] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:41 2022] PUT /identity/v3/projects/36364b26f7a347bfa5808ab0437c452a/users/fa69836f35db4ccfac1320d4dcd8607e/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:41.320962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6ff5f-45ae-4fe7-b8b2-e18dd8755c24 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:41.552828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d41135-7fa7-4613-bdc5-770ee210a187 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:41.613016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6ff5f-45ae-4fe7-b8b2-e18dd8755c24 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:41.641848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26080b4-3858-4375-976a-70a69f30532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:41.642690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26080b4-3858-4375-976a-70a69f30532b admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:41.643193 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26080b4-3858-4375-976a-70a69f30532b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:41.643490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26080b4-3858-4375-976a-70a69f30532b admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:41.644371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26080b4-3858-4375-976a-70a69f30532b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:41.646032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26080b4-3858-4375-976a-70a69f30532b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:41.707071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 854/1675] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:41.708225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26080b4-3858-4375-976a-70a69f30532b admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:41.758067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26080b4-3858-4375-976a-70a69f30532b admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:41.786954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf536d27-62ed-4937-95a4-ceded0b5118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:41.790537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf536d27-62ed-4937-95a4-ceded0b5118e admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:41.790537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf536d27-62ed-4937-95a4-ceded0b5118e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:41.790537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf536d27-62ed-4937-95a4-ceded0b5118e admin admin] PATH_INFO: `/v3/projects/36364b26f7a347bfa5808ab0437c452a/users/fa69836f35db4ccfac1320d4dcd8607e/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:41.812559 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf536d27-62ed-4937-95a4-ceded0b5118e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36364b26f7a347bfa5808ab0437c452a, user_id=fa69836f35db4ccfac1320d4dcd8607e, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:41.827004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf536d27-62ed-4937-95a4-ceded0b5118e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:41.848838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736e37d-01a8-4b56-8058-7fa9990b9891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:41.849745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736e37d-01a8-4b56-8058-7fa9990b9891 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:41.850174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736e37d-01a8-4b56-8058-7fa9990b9891 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:41.850593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736e37d-01a8-4b56-8058-7fa9990b9891 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:41.851448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736e37d-01a8-4b56-8058-7fa9990b9891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:41.854491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736e37d-01a8-4b56-8058-7fa9990b9891 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:41.880568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 855/1676] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:41 2022] PUT /identity/v3/projects/36364b26f7a347bfa5808ab0437c452a/users/fa69836f35db4ccfac1320d4dcd8607e/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:41.892131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64f4db-7502-496b-9fc1-29fe80c7a6c4 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:41.892671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64f4db-7502-496b-9fc1-29fe80c7a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:41.893082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64f4db-7502-496b-9fc1-29fe80c7a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:41.999780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 822/1677] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:41 2022] POST /identity/v3/users => generated 287 bytes in 746 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:42.001562 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736e37d-01a8-4b56-8058-7fa9990b9891 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:42.022946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736e37d-01a8-4b56-8058-7fa9990b9891 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:42.081480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-0d64f4db-7502-496b-9fc1-29fe80c7a6c4 None None] MFA Rules not processed for user `fa69836f35db4ccfac1320d4dcd8607e`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:42.083108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-0d64f4db-7502-496b-9fc1-29fe80c7a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:42.170449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9e403-d663-492a-aa79-514c9a635263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:42.171355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9e403-d663-492a-aa79-514c9a635263 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:42.171725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9e403-d663-492a-aa79-514c9a635263 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:42.172105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9e403-d663-492a-aa79-514c9a635263 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:42.172902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9e403-d663-492a-aa79-514c9a635263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:42.179894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9e403-d663-492a-aa79-514c9a635263 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:42.209417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 823/1678] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:42.213781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9e403-d663-492a-aa79-514c9a635263 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:42.241948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9e403-d663-492a-aa79-514c9a635263 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:42.253010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83341a0-e237-477f-a5b7-50c306c47d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:42.253765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83341a0-e237-477f-a5b7-50c306c47d27 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:42.254205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83341a0-e237-477f-a5b7-50c306c47d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:42.254497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83341a0-e237-477f-a5b7-50c306c47d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:42.255588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83341a0-e237-477f-a5b7-50c306c47d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:42.257578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83341a0-e237-477f-a5b7-50c306c47d27 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:42.272481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 824/1679] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:04:42.277724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83341a0-e237-477f-a5b7-50c306c47d27 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:42.291404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83341a0-e237-477f-a5b7-50c306c47d27 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:42.298839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8f4d1-a4b0-48b2-b85f-b6818f57c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:42.299986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8f4d1-a4b0-48b2-b85f-b6818f57c11f admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:42.300444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8f4d1-a4b0-48b2-b85f-b6818f57c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:42.300738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8f4d1-a4b0-48b2-b85f-b6818f57c11f admin admin] PATH_INFO: `/v3/projects/03745667375749da923c92be9a096874/users/87b2a591d10b4237b46047582ea65830/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:42.322941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8f4d1-a4b0-48b2-b85f-b6818f57c11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03745667375749da923c92be9a096874, user_id=87b2a591d10b4237b46047582ea65830, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:42.326360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8f4d1-a4b0-48b2-b85f-b6818f57c11f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:42.354536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 856/1680] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:42.378936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64f4db-7502-496b-9fc1-29fe80c7a6c4 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:42.383636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-0d64f4db-7502-496b-9fc1-29fe80c7a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:42.492592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 825/1681] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:42 2022] PUT /identity/v3/projects/03745667375749da923c92be9a096874/users/87b2a591d10b4237b46047582ea65830/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:42.506423 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a59f92-abbf-4cfc-bfdc-8a72ad51c964 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:42.506611 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a59f92-abbf-4cfc-bfdc-8a72ad51c964 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:42.506842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a59f92-abbf-4cfc-bfdc-8a72ad51c964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:42.542711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64f4db-7502-496b-9fc1-29fe80c7a6c4 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:42.604918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-94a59f92-abbf-4cfc-bfdc-8a72ad51c964 None None] MFA Rules not processed for user `87b2a591d10b4237b46047582ea65830`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:42.613664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-94a59f92-abbf-4cfc-bfdc-8a72ad51c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:42.793055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e317a5-e231-48fe-85cb-297295be0da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:42.798591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e317a5-e231-48fe-85cb-297295be0da2 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:42.802426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e317a5-e231-48fe-85cb-297295be0da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:42.803041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e317a5-e231-48fe-85cb-297295be0da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:42.957764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 826/1682] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:42.964036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a59f92-abbf-4cfc-bfdc-8a72ad51c964 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:42.968528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-94a59f92-abbf-4cfc-bfdc-8a72ad51c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:43.005276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e317a5-e231-48fe-85cb-297295be0da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:43.006768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e317a5-e231-48fe-85cb-297295be0da2 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:43.033738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:43.037151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 857/1683] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:43.088930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a191f7f-bb0e-481d-931d-d729febf59e1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:43.089316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a191f7f-bb0e-481d-931d-d729febf59e1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:43.089463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a191f7f-bb0e-481d-931d-d729febf59e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:43.147350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9a191f7f-bb0e-481d-931d-d729febf59e1 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:43.148792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9a191f7f-bb0e-481d-931d-d729febf59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:43.153983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:43.282147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a59f92-abbf-4cfc-bfdc-8a72ad51c964 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:43.300652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29015e6-b17c-45ee-afb0-f2d89ba02e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:43.301336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29015e6-b17c-45ee-afb0-f2d89ba02e11 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:43.301624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29015e6-b17c-45ee-afb0-f2d89ba02e11 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:43.301908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29015e6-b17c-45ee-afb0-f2d89ba02e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:43.324219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29015e6-b17c-45ee-afb0-f2d89ba02e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:43.328836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29015e6-b17c-45ee-afb0-f2d89ba02e11 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:43.348729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 858/1684] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:04:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:43.375716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 827/1685] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:43.561078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a191f7f-bb0e-481d-931d-d729febf59e1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:43.562783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9a191f7f-bb0e-481d-931d-d729febf59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:43.589711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a191f7f-bb0e-481d-931d-d729febf59e1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:43.611162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:43.611897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:43.612183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:43.612460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:43.622010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:43.901036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:43.902611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:44.006475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 859/1686] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:44.155804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29015e6-b17c-45ee-afb0-f2d89ba02e11 service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:44.159925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:44.162294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:44.455500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332e3d5-c23e-4f47-8ec0-cc5fcd5109fe service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:44.470213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97a4d9-2c90-4d9c-8a2c-66fdf7d2ba93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:44.470890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a4d9-2c90-4d9c-8a2c-66fdf7d2ba93 service swift] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:44.471174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a4d9-2c90-4d9c-8a2c-66fdf7d2ba93 service swift] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:44.471517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a4d9-2c90-4d9c-8a2c-66fdf7d2ba93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:44.495178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97a4d9-2c90-4d9c-8a2c-66fdf7d2ba93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:44.496999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97a4d9-2c90-4d9c-8a2c-66fdf7d2ba93 service swift] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:44.527718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 860/1687] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:04:44.537149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29015e6-b17c-45ee-afb0-f2d89ba02e11 service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:44.562766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:44.565093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:44.565570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:44.565948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] PATH_INFO: `/v3/users/87b2a591d10b4237b46047582ea65830` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:44.567555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b2a591d10b4237b46047582ea65830)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:44.569878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:44.822152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97a4d9-2c90-4d9c-8a2c-66fdf7d2ba93 service swift] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:44.824044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ed97a4d9-2c90-4d9c-8a2c-66fdf7d2ba93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:44.854562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:44.893297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b2a591d10b4237b46047582ea65830'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:44.894827 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97a4d9-2c90-4d9c-8a2c-66fdf7d2ba93 service swift] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:44.926723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b2a591d10b4237b46047582ea65830'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:44.927929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b2a591d10b4237b46047582ea65830'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:44.933941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:44.933941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:44.933941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:44.933941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] PATH_INFO: `/v3/users/98a415385a3240e8aadc6ef12c249fe3` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:44.936084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:44.938948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a415385a3240e8aadc6ef12c249fe3)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:44.941081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:45.004067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b2a591d10b4237b46047582ea65830'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:45.008578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f81475a9-e94d-4903-b71b-c26c0649711f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b2a591d10b4237b46047582ea65830'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:45.179668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 828/1688] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:04:44 2022] DELETE /identity/v3/users/87b2a591d10b4237b46047582ea65830 => generated 0 bytes in 1021 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:45.182013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17968c5b-43c3-48c3-9415-dd7ad4f42225 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:45.182317 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17968c5b-43c3-48c3-9415-dd7ad4f42225 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:45.182599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17968c5b-43c3-48c3-9415-dd7ad4f42225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:45.233820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-17968c5b-43c3-48c3-9415-dd7ad4f42225 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:45.239247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-17968c5b-43c3-48c3-9415-dd7ad4f42225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:45.404827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 829/1689] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:45.431832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17968c5b-43c3-48c3-9415-dd7ad4f42225 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:45.433528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-17968c5b-43c3-48c3-9415-dd7ad4f42225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:45.467495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a415385a3240e8aadc6ef12c249fe3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:45.559073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a415385a3240e8aadc6ef12c249fe3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:45.568460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a415385a3240e8aadc6ef12c249fe3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:45.584341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17968c5b-43c3-48c3-9415-dd7ad4f42225 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:45.594444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ff5d5-b0fb-45c7-8762-ec77cb7152df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:45.596943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ff5d5-b0fb-45c7-8762-ec77cb7152df service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:45.597233 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ff5d5-b0fb-45c7-8762-ec77cb7152df service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:45.597665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ff5d5-b0fb-45c7-8762-ec77cb7152df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:45.602250 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a415385a3240e8aadc6ef12c249fe3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:45.608840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ed9531f8-bd68-4162-b22e-2cb764dfbfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a415385a3240e8aadc6ef12c249fe3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:45.620276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ff5d5-b0fb-45c7-8762-ec77cb7152df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:45.627128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 861/1690] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:04:44 2022] DELETE /identity/v3/users/98a415385a3240e8aadc6ef12c249fe3 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:45.630855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ff5d5-b0fb-45c7-8762-ec77cb7152df service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:45.632008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff896493-9b92-41db-8b48-af9aa086cc4e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:45.632549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff896493-9b92-41db-8b48-af9aa086cc4e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:45.632971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff896493-9b92-41db-8b48-af9aa086cc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:45.662841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 830/1691] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:04:45.674986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-ff896493-9b92-41db-8b48-af9aa086cc4e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:45.676568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ff896493-9b92-41db-8b48-af9aa086cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:45.791685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 862/1692] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:45.916694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ff5d5-b0fb-45c7-8762-ec77cb7152df service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:45.919467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-016ff5d5-b0fb-45c7-8762-ec77cb7152df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:45.943353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ff5d5-b0fb-45c7-8762-ec77cb7152df service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:46.195702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743f96-fe1b-408d-b9b5-efef010f5eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:46.195702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743f96-fe1b-408d-b9b5-efef010f5eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:46.195702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743f96-fe1b-408d-b9b5-efef010f5eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:46.195702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743f96-fe1b-408d-b9b5-efef010f5eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:46.222256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0743f96-fe1b-408d-b9b5-efef010f5eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:46.222256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0743f96-fe1b-408d-b9b5-efef010f5eb7 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:46.222256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 831/1693] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:47.095318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c2c2-ae7d-424c-9ee3-e7f1f781550a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:47.096290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c2c2-ae7d-424c-9ee3-e7f1f781550a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:47.096849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c2c2-ae7d-424c-9ee3-e7f1f781550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:47.174250 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-23d4c2c2-ae7d-424c-9ee3-e7f1f781550a None None] MFA Rules not processed for user `7f8a3035f5c54f3d84e2a81240a9306f`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:47.175858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-23d4c2c2-ae7d-424c-9ee3-e7f1f781550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:47.435540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 863/1694] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:47.444206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743f96-fe1b-408d-b9b5-efef010f5eb7 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:47.446751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e0743f96-fe1b-408d-b9b5-efef010f5eb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:47.491221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:47.695227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743f96-fe1b-408d-b9b5-efef010f5eb7 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:47.718056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:47.760347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e2799-a4ff-4995-9376-d769c8f34b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:47.764557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e2799-a4ff-4995-9376-d769c8f34b87 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:47.767465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e2799-a4ff-4995-9376-d769c8f34b87 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:47.767917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e2799-a4ff-4995-9376-d769c8f34b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:47.803447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e2799-a4ff-4995-9376-d769c8f34b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:47.806497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e2799-a4ff-4995-9376-d769c8f34b87 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:47.851944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 832/1695] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:48.554809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:48.732053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4c2c2-ae7d-424c-9ee3-e7f1f781550a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:48.739182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-23d4c2c2-ae7d-424c-9ee3-e7f1f781550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:48.780502 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4c2c2-ae7d-424c-9ee3-e7f1f781550a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:48.806625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:48.807839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:48.808313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:48.808922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] PATH_INFO: `/v3/projects/03745667375749da923c92be9a096874` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:48.811654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03745667375749da923c92be9a096874)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:48.820821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:49.049203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03745667375749da923c92be9a096874', 'request_id': 'req-198885da-070e-452c-b824-2b355ea107c5'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.064132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03745667375749da923c92be9a096874', 'request_id': 'req-198885da-070e-452c-b824-2b355ea107c5'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.079971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03745667375749da923c92be9a096874', 'request_id': 'req-198885da-070e-452c-b824-2b355ea107c5'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.184276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] The token cache is being invalidate because project 03745667375749da923c92be9a096874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:04:49.184578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.189843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-198885da-070e-452c-b824-2b355ea107c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.189843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 864/1696] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:04:48 2022] DELETE /identity/v3/projects/03745667375749da923c92be9a096874 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:49.195402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c331a2-6382-41f4-b154-c85075516196 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:49.196556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c331a2-6382-41f4-b154-c85075516196 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:49.196556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c331a2-6382-41f4-b154-c85075516196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:49.259897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-66c331a2-6382-41f4-b154-c85075516196 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:49.261696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-66c331a2-6382-41f4-b154-c85075516196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:49.422197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 833/1697] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:49.431669 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836d38c-05e3-4426-a667-5fabd5de5466 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:49.431954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836d38c-05e3-4426-a667-5fabd5de5466 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:49.432390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836d38c-05e3-4426-a667-5fabd5de5466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:49.474187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c331a2-6382-41f4-b154-c85075516196 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:49.475843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-66c331a2-6382-41f4-b154-c85075516196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:49.482949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3836d38c-05e3-4426-a667-5fabd5de5466 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:49.485631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3836d38c-05e3-4426-a667-5fabd5de5466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:49.501039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c331a2-6382-41f4-b154-c85075516196 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:49.504494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 865/1698] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:49.516690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:49.517653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:49.518013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:49.518380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] PATH_INFO: `/v3/projects/58af55f0b3154776bf2952da17dd6087` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:49.522826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836d38c-05e3-4426-a667-5fabd5de5466 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:49.529318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58af55f0b3154776bf2952da17dd6087)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:49.533218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:49.551511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836d38c-05e3-4426-a667-5fabd5de5466 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:49.557184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa5cb1-c8e7-405f-90fb-dd84485e81c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:49.572645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa5cb1-c8e7-405f-90fb-dd84485e81c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:49.573387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa5cb1-c8e7-405f-90fb-dd84485e81c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:49.573957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa5cb1-c8e7-405f-90fb-dd84485e81c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:49.575110 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa5cb1-c8e7-405f-90fb-dd84485e81c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:49.575666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa5cb1-c8e7-405f-90fb-dd84485e81c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:49.578013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa5cb1-c8e7-405f-90fb-dd84485e81c7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:49.609014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 866/1699] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:49.611291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6470-d174-4cc8-8f47-420f2d4eca02 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:49.611889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6470-d174-4cc8-8f47-420f2d4eca02 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:49.612338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6470-d174-4cc8-8f47-420f2d4eca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:49.707726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-852b6470-d174-4cc8-8f47-420f2d4eca02 None None] MFA Rules not processed for user `f4794216544c4b969910eb48c2769f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:49.709113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-852b6470-d174-4cc8-8f47-420f2d4eca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:49.796033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58af55f0b3154776bf2952da17dd6087', 'request_id': 'req-2e071404-9a83-4d18-984e-af3dee51eb4c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.815065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58af55f0b3154776bf2952da17dd6087', 'request_id': 'req-2e071404-9a83-4d18-984e-af3dee51eb4c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.827358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58af55f0b3154776bf2952da17dd6087', 'request_id': 'req-2e071404-9a83-4d18-984e-af3dee51eb4c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.927366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] The token cache is being invalidate because project 58af55f0b3154776bf2952da17dd6087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:04:49.929702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.929702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2e071404-9a83-4d18-984e-af3dee51eb4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:49.931468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 867/1700] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:49.932637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b6470-d174-4cc8-8f47-420f2d4eca02 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:49.933172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 834/1701] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:04:49 2022] DELETE /identity/v3/projects/58af55f0b3154776bf2952da17dd6087 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:04:49.934723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2968-eb9a-4160-b12b-79f16eca98be None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:49.935020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2968-eb9a-4160-b12b-79f16eca98be None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:49.935300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2968-eb9a-4160-b12b-79f16eca98be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:49.981392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b6470-d174-4cc8-8f47-420f2d4eca02 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:49.993605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ca5c2968-eb9a-4160-b12b-79f16eca98be None None] MFA Rules not processed for user `8fee665c10364944a8162548f91a431e`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:49.996850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ca5c2968-eb9a-4160-b12b-79f16eca98be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:50.073315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 835/1702] 10.222.0.72 () {58 vars in 1015 bytes} [Thu May 26 17:04:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:50.074667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1dcbd-94ff-49f6-ac7a-ff4e567c9b7d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:50.074959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1dcbd-94ff-49f6-ac7a-ff4e567c9b7d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:50.075243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1dcbd-94ff-49f6-ac7a-ff4e567c9b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:50.103742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-efa1dcbd-94ff-49f6-ac7a-ff4e567c9b7d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:50.104980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-efa1dcbd-94ff-49f6-ac7a-ff4e567c9b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:50.194719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:50.204632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a32b38-565d-45b2-a1f0-2d614cce4d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:50.207803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a32b38-565d-45b2-a1f0-2d614cce4d3e admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:50.208381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a32b38-565d-45b2-a1f0-2d614cce4d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:50.210268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a32b38-565d-45b2-a1f0-2d614cce4d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:50.223690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a32b38-565d-45b2-a1f0-2d614cce4d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:50.225677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a32b38-565d-45b2-a1f0-2d614cce4d3e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:50.314601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 836/1703] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:50.316811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381250e4-cd7c-49c8-afeb-9313fa4f1d36 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:50.317339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381250e4-cd7c-49c8-afeb-9313fa4f1d36 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:50.317830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381250e4-cd7c-49c8-afeb-9313fa4f1d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:50.374939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-381250e4-cd7c-49c8-afeb-9313fa4f1d36 None None] MFA Rules not processed for user `f4794216544c4b969910eb48c2769f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:50.383079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-381250e4-cd7c-49c8-afeb-9313fa4f1d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:50.391464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 868/1704] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:49 2022] POST /identity/v3/projects => generated 365 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:50.398471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a32b38-565d-45b2-a1f0-2d614cce4d3e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:50.403727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-17a32b38-565d-45b2-a1f0-2d614cce4d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:50.549642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 837/1705] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:50.551375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b98c-9476-4431-8e64-ea9d7b2da15d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:50.551950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b98c-9476-4431-8e64-ea9d7b2da15d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:50.556417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b98c-9476-4431-8e64-ea9d7b2da15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:50.562774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a32b38-565d-45b2-a1f0-2d614cce4d3e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:50.575870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ed36-e101-4102-8f64-dc64ebd6a146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:50.576601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ed36-e101-4102-8f64-dc64ebd6a146 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:50.576895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ed36-e101-4102-8f64-dc64ebd6a146 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:50.577223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ed36-e101-4102-8f64-dc64ebd6a146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:50.589431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d728b98c-9476-4431-8e64-ea9d7b2da15d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:50.596186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d728b98c-9476-4431-8e64-ea9d7b2da15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:50.599322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ed36-e101-4102-8f64-dc64ebd6a146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:50.604303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ed36-e101-4102-8f64-dc64ebd6a146 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:50.629238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 869/1706] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:50.634624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ed36-e101-4102-8f64-dc64ebd6a146 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:50.640830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5148ed36-e101-4102-8f64-dc64ebd6a146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:50.769661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 838/1707] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:50.773182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728b98c-9476-4431-8e64-ea9d7b2da15d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:50.774176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d728b98c-9476-4431-8e64-ea9d7b2da15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:50.934035 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ed36-e101-4102-8f64-dc64ebd6a146 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:50.963000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300449f9-3b2f-43d9-b65b-d31e410b3558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:50.963769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300449f9-3b2f-43d9-b65b-d31e410b3558 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:50.964100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300449f9-3b2f-43d9-b65b-d31e410b3558 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:50.965100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300449f9-3b2f-43d9-b65b-d31e410b3558 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:50.965860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300449f9-3b2f-43d9-b65b-d31e410b3558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:50.976524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300449f9-3b2f-43d9-b65b-d31e410b3558 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:51.157862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 870/1708] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:50 2022] POST /identity/v3/users => generated 283 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:51.158899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300449f9-3b2f-43d9-b65b-d31e410b3558 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:51.181728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300449f9-3b2f-43d9-b65b-d31e410b3558 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:51.196857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a33ce4-4f00-48b5-b423-8ed5d94ab648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:51.197543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33ce4-4f00-48b5-b423-8ed5d94ab648 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:51.197824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33ce4-4f00-48b5-b423-8ed5d94ab648 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:51.198095 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33ce4-4f00-48b5-b423-8ed5d94ab648 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:51.198837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a33ce4-4f00-48b5-b423-8ed5d94ab648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:04:51.199959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a33ce4-4f00-48b5-b423-8ed5d94ab648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:51.200937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a33ce4-4f00-48b5-b423-8ed5d94ab648 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:51.209036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728b98c-9476-4431-8e64-ea9d7b2da15d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:51.227232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246508b1-df0d-49b7-a954-c1cfd7817a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:51.233399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246508b1-df0d-49b7-a954-c1cfd7817a5f service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:51.235906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246508b1-df0d-49b7-a954-c1cfd7817a5f service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:51.235906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246508b1-df0d-49b7-a954-c1cfd7817a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:51.238785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 871/1709] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:04:51.239844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a33ce4-4f00-48b5-b423-8ed5d94ab648 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:51.244954 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-246508b1-df0d-49b7-a954-c1cfd7817a5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:51.279784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246508b1-df0d-49b7-a954-c1cfd7817a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:51.280133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a33ce4-4f00-48b5-b423-8ed5d94ab648 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:51.280665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246508b1-df0d-49b7-a954-c1cfd7817a5f service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:51.303521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176d21-5dc2-4abd-bcf3-e7aaaa8db841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:51.304244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176d21-5dc2-4abd-bcf3-e7aaaa8db841 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:51.304528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176d21-5dc2-4abd-bcf3-e7aaaa8db841 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:51.304805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176d21-5dc2-4abd-bcf3-e7aaaa8db841 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:51.305286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 839/1710] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:51.306268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29176d21-5dc2-4abd-bcf3-e7aaaa8db841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:51.307958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29176d21-5dc2-4abd-bcf3-e7aaaa8db841 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:51.313065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246508b1-df0d-49b7-a954-c1cfd7817a5f service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:51.341917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246508b1-df0d-49b7-a954-c1cfd7817a5f service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:51.353694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 872/1711] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:51.353694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176d21-5dc2-4abd-bcf3-e7aaaa8db841 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:51.356007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0aa29c-5a96-496d-a109-a497ca21eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:51.360672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0aa29c-5a96-496d-a109-a497ca21eac6 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:51.361387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0aa29c-5a96-496d-a109-a497ca21eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:51.361870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0aa29c-5a96-496d-a109-a497ca21eac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:51.364645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0aa29c-5a96-496d-a109-a497ca21eac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:51.371231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0aa29c-5a96-496d-a109-a497ca21eac6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:51.378275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176d21-5dc2-4abd-bcf3-e7aaaa8db841 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:51.408194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270bbb5-fd1a-4659-8d4e-8f414ed1ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:51.408905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bbb5-fd1a-4659-8d4e-8f414ed1ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:51.409191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bbb5-fd1a-4659-8d4e-8f414ed1ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:51.409486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bbb5-fd1a-4659-8d4e-8f414ed1ad94 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:51.410228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270bbb5-fd1a-4659-8d4e-8f414ed1ad94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:51.411945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270bbb5-fd1a-4659-8d4e-8f414ed1ad94 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:51.463885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 873/1712] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:51.464909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270bbb5-fd1a-4659-8d4e-8f414ed1ad94 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:51.505925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270bbb5-fd1a-4659-8d4e-8f414ed1ad94 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:51.529757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890d5c-bf56-4ad6-93b8-a2a0136edd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:51.530980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890d5c-bf56-4ad6-93b8-a2a0136edd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:51.531937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890d5c-bf56-4ad6-93b8-a2a0136edd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:51.534234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890d5c-bf56-4ad6-93b8-a2a0136edd41 admin admin] PATH_INFO: `/v3/projects/73e2017354464dc59654dd1ea05dc4ef/users/df1c35d82f3d4457ae007f3b503fde66/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:51.543862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 840/1713] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:51 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:51.545575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0aa29c-5a96-496d-a109-a497ca21eac6 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:51.589507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26890d5c-bf56-4ad6-93b8-a2a0136edd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e2017354464dc59654dd1ea05dc4ef, user_id=df1c35d82f3d4457ae007f3b503fde66, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:51.593206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26890d5c-bf56-4ad6-93b8-a2a0136edd41 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:51.713289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 874/1714] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:51 2022] PUT /identity/v3/projects/73e2017354464dc59654dd1ea05dc4ef/users/df1c35d82f3d4457ae007f3b503fde66/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:51.725266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3a294-b56e-4589-9525-6eaee95ae34b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:51.725582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3a294-b56e-4589-9525-6eaee95ae34b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:51.725860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3a294-b56e-4589-9525-6eaee95ae34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:51.772760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-47b3a294-b56e-4589-9525-6eaee95ae34b None None] MFA Rules not processed for user `df1c35d82f3d4457ae007f3b503fde66`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:51.774748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-47b3a294-b56e-4589-9525-6eaee95ae34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:51.807350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0aa29c-5a96-496d-a109-a497ca21eac6 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:51.908037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 875/1715] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:51.909323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3a294-b56e-4589-9525-6eaee95ae34b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:51.997677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a85fb9-5070-4a27-8107-7659bdb3bcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:51.998741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85fb9-5070-4a27-8107-7659bdb3bcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:52.013253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85fb9-5070-4a27-8107-7659bdb3bcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:52.013804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85fb9-5070-4a27-8107-7659bdb3bcb6 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:52.014572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a85fb9-5070-4a27-8107-7659bdb3bcb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:52.019490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a85fb9-5070-4a27-8107-7659bdb3bcb6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:52.079186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3a294-b56e-4589-9525-6eaee95ae34b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:52.127945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90be88-c3e5-4558-9f6b-9a817f375c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:52.135288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90be88-c3e5-4558-9f6b-9a817f375c0d admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:52.135698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90be88-c3e5-4558-9f6b-9a817f375c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:52.135985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90be88-c3e5-4558-9f6b-9a817f375c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:52.150097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90be88-c3e5-4558-9f6b-9a817f375c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:52.163777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90be88-c3e5-4558-9f6b-9a817f375c0d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:52.202776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 841/1716] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:51 2022] POST /identity/v3/users => generated 293 bytes in 658 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:52.208502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a85fb9-5070-4a27-8107-7659bdb3bcb6 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:52.246061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a85fb9-5070-4a27-8107-7659bdb3bcb6 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:52.276580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a18fc0-68b3-47a5-9eb4-49aab6111a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:52.278377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a18fc0-68b3-47a5-9eb4-49aab6111a41 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:52.280087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a18fc0-68b3-47a5-9eb4-49aab6111a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:52.280580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a18fc0-68b3-47a5-9eb4-49aab6111a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:52.291080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a18fc0-68b3-47a5-9eb4-49aab6111a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:52.297414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a18fc0-68b3-47a5-9eb4-49aab6111a41 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:52.316762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 876/1717] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:51 2022] POST /identity/v3/projects => generated 365 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:52.317768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90be88-c3e5-4558-9f6b-9a817f375c0d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:52.346067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 842/1718] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:52.355451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a18fc0-68b3-47a5-9eb4-49aab6111a41 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:52.403229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a18fc0-68b3-47a5-9eb4-49aab6111a41 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:52.608719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90be88-c3e5-4558-9f6b-9a817f375c0d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:52.635310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb335e7-6413-4446-87c3-723725e59d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:52.636919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb335e7-6413-4446-87c3-723725e59d63 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:52.637233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb335e7-6413-4446-87c3-723725e59d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:52.637475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb335e7-6413-4446-87c3-723725e59d63 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:52.639702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb335e7-6413-4446-87c3-723725e59d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:52.642551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb335e7-6413-4446-87c3-723725e59d63 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:52.660974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6265a-5c75-4bc9-a46e-710f03726ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:52.661672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6265a-5c75-4bc9-a46e-710f03726ebc admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:52.661950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6265a-5c75-4bc9-a46e-710f03726ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:52.662221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6265a-5c75-4bc9-a46e-710f03726ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:52.666259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:52.691735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6265a-5c75-4bc9-a46e-710f03726ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:52.698664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6265a-5c75-4bc9-a46e-710f03726ebc admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:52.738207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 843/1719] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:52.754120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6265a-5c75-4bc9-a46e-710f03726ebc admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:52.775857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6265a-5c75-4bc9-a46e-710f03726ebc admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:52.783432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac7a31-fe8e-498d-8651-d2d7cd5111ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:52.786482 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac7a31-fe8e-498d-8651-d2d7cd5111ac admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:52.818619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 877/1720] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:52 2022] POST /identity/v3/users => generated 289 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:52.821528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa79ab-8954-410f-9ff4-29b8387f4924 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:52.822763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac7a31-fe8e-498d-8651-d2d7cd5111ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:52.823625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa79ab-8954-410f-9ff4-29b8387f4924 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:52.824104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac7a31-fe8e-498d-8651-d2d7cd5111ac admin admin] PATH_INFO: `/v3/projects/43fc95147d20410b8541d1381e001dfa/users/aeeb5054cab94200804c320790acd907/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:52.825725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa79ab-8954-410f-9ff4-29b8387f4924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:52.878280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac7a31-fe8e-498d-8651-d2d7cd5111ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fc95147d20410b8541d1381e001dfa, user_id=aeeb5054cab94200804c320790acd907, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:52.880516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-cdfa79ab-8954-410f-9ff4-29b8387f4924 None None] MFA Rules not processed for user `bc0e583fb8414bde82872ccc4726e5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:52.885255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-cdfa79ab-8954-410f-9ff4-29b8387f4924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:52.886776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac7a31-fe8e-498d-8651-d2d7cd5111ac admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:53.046396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 844/1721] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:52 2022] PUT /identity/v3/projects/43fc95147d20410b8541d1381e001dfa/users/aeeb5054cab94200804c320790acd907/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:53.047372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac7a31-fe8e-498d-8651-d2d7cd5111ac admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:53.077642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 878/1722] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:53.082879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41d35-cadb-48ea-9593-e853d99b1c69 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:53.088732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41d35-cadb-48ea-9593-e853d99b1c69 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:53.088732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41d35-cadb-48ea-9593-e853d99b1c69 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:53.088732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 879/1723] 10.222.0.93 () {54 vars in 912 bytes} [Thu May 26 17:04:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:04:53.091829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1fdc8-74d3-432e-a74c-9d3cefeb6b6c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:53.092151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1fdc8-74d3-432e-a74c-9d3cefeb6b6c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:53.092933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1fdc8-74d3-432e-a74c-9d3cefeb6b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:53.238598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-41e1fdc8-74d3-432e-a74c-9d3cefeb6b6c None None] MFA Rules not processed for user `aeeb5054cab94200804c320790acd907`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:53.240299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-41e1fdc8-74d3-432e-a74c-9d3cefeb6b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:53.319799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac7a31-fe8e-498d-8651-d2d7cd5111ac admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:53.328416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69699df-eaf8-40e0-bc69-4618a13fe3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:53.329409 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69699df-eaf8-40e0-bc69-4618a13fe3be admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:53.329923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69699df-eaf8-40e0-bc69-4618a13fe3be admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:53.330356 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69699df-eaf8-40e0-bc69-4618a13fe3be admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:53.331257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69699df-eaf8-40e0-bc69-4618a13fe3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:53.337866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69699df-eaf8-40e0-bc69-4618a13fe3be admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:53.375724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 845/1724] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:53.378547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750d7b-2c77-44c9-a7f3-39914a4fc3ba None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:53.379308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750d7b-2c77-44c9-a7f3-39914a4fc3ba None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:53.379869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750d7b-2c77-44c9-a7f3-39914a4fc3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:53.410499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-30750d7b-2c77-44c9-a7f3-39914a4fc3ba None None] MFA Rules not processed for user `8fee665c10364944a8162548f91a431e`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:53.412171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-30750d7b-2c77-44c9-a7f3-39914a4fc3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:53.421550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 880/1725] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:53.437547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1fdc8-74d3-432e-a74c-9d3cefeb6b6c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:53.461158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1fdc8-74d3-432e-a74c-9d3cefeb6b6c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:53.467345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930851-f331-47e2-bea0-d10bffdd3c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:53.469438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930851-f331-47e2-bea0-d10bffdd3c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:53.469947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930851-f331-47e2-bea0-d10bffdd3c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:53.470447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930851-f331-47e2-bea0-d10bffdd3c40 admin admin] PATH_INFO: `/v3/projects/7e5cb3b4ff0e45409d9d8266bff652c0/users/7804665fae1f43c9ad89d8ab6a8134f3/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:53.492848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb930851-f331-47e2-bea0-d10bffdd3c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5cb3b4ff0e45409d9d8266bff652c0, user_id=7804665fae1f43c9ad89d8ab6a8134f3, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:53.495735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb930851-f331-47e2-bea0-d10bffdd3c40 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:53.636311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 881/1726] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:53 2022] PUT /identity/v3/projects/7e5cb3b4ff0e45409d9d8266bff652c0/users/7804665fae1f43c9ad89d8ab6a8134f3/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:53.636311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930851-f331-47e2-bea0-d10bffdd3c40 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:53.748860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 846/1727] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:04:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:53.750446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30750d7b-2c77-44c9-a7f3-39914a4fc3ba None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:53.785007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930851-f331-47e2-bea0-d10bffdd3c40 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:53.808094 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463d90a-139c-435b-9ade-910251d039f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:53.809370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463d90a-139c-435b-9ade-910251d039f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:53.809805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463d90a-139c-435b-9ade-910251d039f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:53.811957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463d90a-139c-435b-9ade-910251d039f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:53.812910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463d90a-139c-435b-9ade-910251d039f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:53.816479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463d90a-139c-435b-9ade-910251d039f3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:53.823065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30750d7b-2c77-44c9-a7f3-39914a4fc3ba None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:53.869443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a61d6d-8cc9-40e3-8f23-7b42814668c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:53.870697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61d6d-8cc9-40e3-8f23-7b42814668c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:53.871105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61d6d-8cc9-40e3-8f23-7b42814668c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:53.871361 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61d6d-8cc9-40e3-8f23-7b42814668c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:53.872254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a61d6d-8cc9-40e3-8f23-7b42814668c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:53.874686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a61d6d-8cc9-40e3-8f23-7b42814668c1 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:53.922033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 847/1728] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:53.922033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a61d6d-8cc9-40e3-8f23-7b42814668c1 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:53.924501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-04a61d6d-8cc9-40e3-8f23-7b42814668c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:53.926116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:53.954547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 882/1729] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:04:53 2022] POST /identity/v3/projects => generated 387 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:53.960617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463d90a-139c-435b-9ade-910251d039f3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:54.065020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a61d6d-8cc9-40e3-8f23-7b42814668c1 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:54.080223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463d90a-139c-435b-9ade-910251d039f3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:54.096380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2752d-5d0a-4305-9850-ca6392b0d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:54.097531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2752d-5d0a-4305-9850-ca6392b0d53e admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:54.098007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2752d-5d0a-4305-9850-ca6392b0d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:54.098293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2752d-5d0a-4305-9850-ca6392b0d53e admin admin] PATH_INFO: `/v3/projects/7e5cb3b4ff0e45409d9d8266bff652c0/users/7804665fae1f43c9ad89d8ab6a8134f3/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:54.103548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2752d-5d0a-4305-9850-ca6392b0d53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5cb3b4ff0e45409d9d8266bff652c0, user_id=7804665fae1f43c9ad89d8ab6a8134f3, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:54.116026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2752d-5d0a-4305-9850-ca6392b0d53e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:54.164334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 883/1730] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:53 2022] PUT /identity/v3/projects/7e5cb3b4ff0e45409d9d8266bff652c0/users/7804665fae1f43c9ad89d8ab6a8134f3/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:54.165962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2752d-5d0a-4305-9850-ca6392b0d53e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:54.259698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3cd23-1e4d-4bc4-900f-8f1b4f936952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:54.260772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3cd23-1e4d-4bc4-900f-8f1b4f936952 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:54.261264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3cd23-1e4d-4bc4-900f-8f1b4f936952 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:54.261741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3cd23-1e4d-4bc4-900f-8f1b4f936952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:54.288305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3cd23-1e4d-4bc4-900f-8f1b4f936952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:54.293249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3cd23-1e4d-4bc4-900f-8f1b4f936952 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:54.321925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 848/1731] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:54.329234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93faf0-a80a-44a7-afd5-8b3629c92cc3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:54.329727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93faf0-a80a-44a7-afd5-8b3629c92cc3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:54.331431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93faf0-a80a-44a7-afd5-8b3629c92cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:54.395202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2752d-5d0a-4305-9850-ca6392b0d53e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:54.409656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0a93faf0-a80a-44a7-afd5-8b3629c92cc3 None None] MFA Rules not processed for user `7804665fae1f43c9ad89d8ab6a8134f3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:54.413093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0a93faf0-a80a-44a7-afd5-8b3629c92cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:54.423997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5a8de-dadd-41c3-af2e-9e6c689d4d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:54.424608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5a8de-dadd-41c3-af2e-9e6c689d4d92 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:54.424895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5a8de-dadd-41c3-af2e-9e6c689d4d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:54.425182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5a8de-dadd-41c3-af2e-9e6c689d4d92 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:54.425889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5a8de-dadd-41c3-af2e-9e6c689d4d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:54.427922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5a8de-dadd-41c3-af2e-9e6c689d4d92 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:54.555529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 884/1732] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:04:54 2022] POST /identity/v3/users => generated 300 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:04:54.562929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5a8de-dadd-41c3-af2e-9e6c689d4d92 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:54.599217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5a8de-dadd-41c3-af2e-9e6c689d4d92 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:54.621047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cda57-2392-4997-8afc-9fcf96c3fc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:54.621775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cda57-2392-4997-8afc-9fcf96c3fc85 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:54.622056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cda57-2392-4997-8afc-9fcf96c3fc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:54.622328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cda57-2392-4997-8afc-9fcf96c3fc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:54.623057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cda57-2392-4997-8afc-9fcf96c3fc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:54.625962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cda57-2392-4997-8afc-9fcf96c3fc85 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:54.638156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 849/1733] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:54.656935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 885/1734] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:54.661027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93faf0-a80a-44a7-afd5-8b3629c92cc3 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:54.662197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cda57-2392-4997-8afc-9fcf96c3fc85 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:54.669040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a26cda57-2392-4997-8afc-9fcf96c3fc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:54.713384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93faf0-a80a-44a7-afd5-8b3629c92cc3 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:54.727159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f264b-c5dc-455f-9936-01c558c79a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:54.730434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f264b-c5dc-455f-9936-01c558c79a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:54.731370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f264b-c5dc-455f-9936-01c558c79a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:54.732067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f264b-c5dc-455f-9936-01c558c79a28 admin admin] PATH_INFO: `/v3/projects/ace3ed6857ca47cbb014b71bf5458f82/users/401a9222396a4a158ceb46d1da44acef/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:54.800410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f264b-c5dc-455f-9936-01c558c79a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace3ed6857ca47cbb014b71bf5458f82, user_id=401a9222396a4a158ceb46d1da44acef, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:54.804829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f264b-c5dc-455f-9936-01c558c79a28 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:54.897940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cda57-2392-4997-8afc-9fcf96c3fc85 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:54.903316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ea8a9-6277-4fbc-ae61-7a01dc38604e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:54.904275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ea8a9-6277-4fbc-ae61-7a01dc38604e service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:54.904791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ea8a9-6277-4fbc-ae61-7a01dc38604e service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:54.905270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ea8a9-6277-4fbc-ae61-7a01dc38604e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:54.917099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 850/1735] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:54 2022] PUT /identity/v3/projects/ace3ed6857ca47cbb014b71bf5458f82/users/401a9222396a4a158ceb46d1da44acef/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:54.941145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f264b-c5dc-455f-9936-01c558c79a28 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:54.985528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ea8a9-6277-4fbc-ae61-7a01dc38604e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:54.988203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ea8a9-6277-4fbc-ae61-7a01dc38604e service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:55.014532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 886/1736] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:55.131077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f264b-c5dc-455f-9936-01c558c79a28 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:55.171336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50f48-e9a8-454f-a564-93631927540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:55.172180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50f48-e9a8-454f-a564-93631927540d admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:55.174316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50f48-e9a8-454f-a564-93631927540d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:55.174857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50f48-e9a8-454f-a564-93631927540d admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:55.181668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50f48-e9a8-454f-a564-93631927540d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:55.181668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50f48-e9a8-454f-a564-93631927540d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:55.233810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 851/1737] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:04:55.233927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ea8a9-6277-4fbc-ae61-7a01dc38604e service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:55.250014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ea8a9-6277-4fbc-ae61-7a01dc38604e service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:55.271940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c3af-8f7f-41c4-b515-f1279de6cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:55.273026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c3af-8f7f-41c4-b515-f1279de6cf63 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:55.273816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c3af-8f7f-41c4-b515-f1279de6cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:55.274747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c3af-8f7f-41c4-b515-f1279de6cf63 admin admin] PATH_INFO: `/v3/projects/ace3ed6857ca47cbb014b71bf5458f82/users/401a9222396a4a158ceb46d1da44acef/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:55.283469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c3af-8f7f-41c4-b515-f1279de6cf63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace3ed6857ca47cbb014b71bf5458f82, user_id=401a9222396a4a158ceb46d1da44acef, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:55.286794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c3af-8f7f-41c4-b515-f1279de6cf63 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:55.335357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 887/1738] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:04:55 2022] PUT /identity/v3/projects/ace3ed6857ca47cbb014b71bf5458f82/users/401a9222396a4a158ceb46d1da44acef/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:55.359652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04d4a5-25e6-41f0-be47-1867fc6d4a1a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:55.360590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04d4a5-25e6-41f0-be47-1867fc6d4a1a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:55.360976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04d4a5-25e6-41f0-be47-1867fc6d4a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:55.425555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162d3c-b5c3-4da7-b49b-962b94f24540 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:55.425555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162d3c-b5c3-4da7-b49b-962b94f24540 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:55.425899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162d3c-b5c3-4da7-b49b-962b94f24540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:55.427951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:55.444104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-4f04d4a5-25e6-41f0-be47-1867fc6d4a1a None None] MFA Rules not processed for user `401a9222396a4a158ceb46d1da44acef`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:55.445592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4f04d4a5-25e6-41f0-be47-1867fc6d4a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:55.527794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f7162d3c-b5c3-4da7-b49b-962b94f24540 None None] MFA Rules not processed for user `62b8c8b994e54023933a4ff2ecf68f42`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:55.531643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f7162d3c-b5c3-4da7-b49b-962b94f24540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:55.794428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 852/1739] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:55.804780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04d4a5-25e6-41f0-be47-1867fc6d4a1a None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:55.808034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4f04d4a5-25e6-41f0-be47-1867fc6d4a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:55.889265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 888/1740] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:55.907456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04d4a5-25e6-41f0-be47-1867fc6d4a1a None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:55.913513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234c637-d369-4826-beee-34745c2a9493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:55.914189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c637-d369-4826-beee-34745c2a9493 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:55.916205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c637-d369-4826-beee-34745c2a9493 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:55.916205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c637-d369-4826-beee-34745c2a9493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:55.953774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234c637-d369-4826-beee-34745c2a9493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:55.957741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234c637-d369-4826-beee-34745c2a9493 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:55.984476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 853/1741] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:56.194531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162d3c-b5c3-4da7-b49b-962b94f24540 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:56.226816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf62a0-ce60-48f8-b484-3ecadf27d1ff None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:56.227230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf62a0-ce60-48f8-b484-3ecadf27d1ff None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:56.227609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf62a0-ce60-48f8-b484-3ecadf27d1ff None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:56.229494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 854/1742] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 17:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:04:56.308277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:56.473554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb63a-7857-4544-8c6c-96efc0e22fe7 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:56.474274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb63a-7857-4544-8c6c-96efc0e22fe7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:56.474274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb63a-7857-4544-8c6c-96efc0e22fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:56.493223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162d3c-b5c3-4da7-b49b-962b94f24540 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:56.506333 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:56.510973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:56.512527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:56.512838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] PATH_INFO: `/v3/users/aeeb5054cab94200804c320790acd907` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:56.516531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeeb5054cab94200804c320790acd907)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:56.526119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:56.568746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-267cb63a-7857-4544-8c6c-96efc0e22fe7 None None] MFA Rules not processed for user `7f8a3035f5c54f3d84e2a81240a9306f`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:56.589320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-267cb63a-7857-4544-8c6c-96efc0e22fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:56.616265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:56.709947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:56.938285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 855/1743] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:04:56.939463 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cb63a-7857-4544-8c6c-96efc0e22fe7 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:57.061140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeeb5054cab94200804c320790acd907'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:57.182715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cb63a-7857-4544-8c6c-96efc0e22fe7 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:57.226436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeeb5054cab94200804c320790acd907'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:57.233330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4343998-4fcc-4724-9720-8eb9bbd55dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:57.239258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343998-4fcc-4724-9720-8eb9bbd55dbe service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:57.239938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343998-4fcc-4724-9720-8eb9bbd55dbe service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:57.240893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeeb5054cab94200804c320790acd907'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:57.241409 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343998-4fcc-4724-9720-8eb9bbd55dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:57.276484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4343998-4fcc-4724-9720-8eb9bbd55dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:57.279943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4343998-4fcc-4724-9720-8eb9bbd55dbe service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:57.313189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeeb5054cab94200804c320790acd907'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:57.315509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-00d1633e-b71c-4bb6-b4cd-ba331b190a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeeb5054cab94200804c320790acd907'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:57.331931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 889/1744] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:04:56 2022] DELETE /identity/v3/users/aeeb5054cab94200804c320790acd907 => generated 0 bytes in 1138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:57.333368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9350-3c09-441e-a1fd-fade54627c76 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:57.333679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9350-3c09-441e-a1fd-fade54627c76 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:57.333936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9350-3c09-441e-a1fd-fade54627c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:57.344468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 856/1745] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:57.345844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4343998-4fcc-4724-9720-8eb9bbd55dbe service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:57.350573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d4343998-4fcc-4724-9720-8eb9bbd55dbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:57.372854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e0dd9350-3c09-441e-a1fd-fade54627c76 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:57.374081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e0dd9350-3c09-441e-a1fd-fade54627c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:57.416032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4343998-4fcc-4724-9720-8eb9bbd55dbe service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:57.580888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 890/1746] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 17:04:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:57.583255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a999c-4663-4b1d-8c3d-c0be70657c21 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:57.583547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a999c-4663-4b1d-8c3d-c0be70657c21 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:57.583846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a999c-4663-4b1d-8c3d-c0be70657c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:57.605290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:57.607842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:57.607842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:57.607842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] PATH_INFO: `/v3/users/7dbf85904bd140b8ba126b1ce066eef3` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:57.623048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbf85904bd140b8ba126b1ce066eef3)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:57.625208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:57.643123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-949a999c-4663-4b1d-8c3d-c0be70657c21 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:57.644426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-949a999c-4663-4b1d-8c3d-c0be70657c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:57.697483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 891/1747] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:57.697483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c99e9-560a-4d7e-878b-4442bddefd09 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:57.697483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c99e9-560a-4d7e-878b-4442bddefd09 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:57.697483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c99e9-560a-4d7e-878b-4442bddefd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:57.773281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-ed1c99e9-560a-4d7e-878b-4442bddefd09 None None] MFA Rules not processed for user `f4794216544c4b969910eb48c2769f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:57.776672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ed1c99e9-560a-4d7e-878b-4442bddefd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:57.832905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:57.981231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 892/1748] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:57.983438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c99e9-560a-4d7e-878b-4442bddefd09 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:57.985145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbf85904bd140b8ba126b1ce066eef3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:57.989910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ed1c99e9-560a-4d7e-878b-4442bddefd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:58.038905 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbf85904bd140b8ba126b1ce066eef3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:58.040822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c99e9-560a-4d7e-878b-4442bddefd09 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:58.042508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbf85904bd140b8ba126b1ce066eef3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:58.055064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:58.058352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:58.063790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:58.063790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] PATH_INFO: `/v3/users/df1c35d82f3d4457ae007f3b503fde66` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:58.066458 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1c35d82f3d4457ae007f3b503fde66)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:58.076900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:58.139915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbf85904bd140b8ba126b1ce066eef3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:58.141808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbf85904bd140b8ba126b1ce066eef3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:58.270579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 857/1749] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:04:57 2022] DELETE /identity/v3/users/7dbf85904bd140b8ba126b1ce066eef3 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:58.270979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:58.273532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:58.512228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1c35d82f3d4457ae007f3b503fde66'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:58.540444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e33d3-709f-4850-b781-d63fc225dcb5 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:58.566903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:58.567649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:58.568095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:58.568333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:58.575787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:58.634197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:58.643793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:58.652077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1c35d82f3d4457ae007f3b503fde66'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:58.674868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 858/1750] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:58.678080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:58.680083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:58.686187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1c35d82f3d4457ae007f3b503fde66'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:58.693559 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:58.755927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1c35d82f3d4457ae007f3b503fde66'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:58.760059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80cd3082-be76-44b6-ab49-22fc4844f5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1c35d82f3d4457ae007f3b503fde66'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:04:58.782383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 893/1751] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:04:57 2022] DELETE /identity/v3/users/df1c35d82f3d4457ae007f3b503fde66 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:04:58.783808 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f3f05-3cc0-48da-9d0b-9c33a1f060e2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:58.784102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f3f05-3cc0-48da-9d0b-9c33a1f060e2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:58.784378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f3f05-3cc0-48da-9d0b-9c33a1f060e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:58.849706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-475f3f05-3cc0-48da-9d0b-9c33a1f060e2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:58.850514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-475f3f05-3cc0-48da-9d0b-9c33a1f060e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:58.869466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebfc30-e6cc-414d-a19d-bad49bd9a1ab service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:59.073020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:59.073704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:59.073994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:59.074274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:59.082352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:59.194371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 894/1752] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:59.200398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a24c22-a3e1-4ffd-97c2-79de69d87df6 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:59.200691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a24c22-a3e1-4ffd-97c2-79de69d87df6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:59.205577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a24c22-a3e1-4ffd-97c2-79de69d87df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:59.325515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-a0a24c22-a3e1-4ffd-97c2-79de69d87df6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:59.330325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a0a24c22-a3e1-4ffd-97c2-79de69d87df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:59.338783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:59.346171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:59.387730 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 859/1753] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:59.388664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:59.395832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:59.407216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 895/1754] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:59.422833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8577a8-7c88-4826-a2b8-1c27fbfd4df4 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:59.437850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa94da-1cdf-4539-980a-e7819b1a353e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:59.438752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa94da-1cdf-4539-980a-e7819b1a353e service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:59.438911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa94da-1cdf-4539-980a-e7819b1a353e service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:59.439166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa94da-1cdf-4539-980a-e7819b1a353e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:59.461287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa94da-1cdf-4539-980a-e7819b1a353e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:59.463130 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa94da-1cdf-4539-980a-e7819b1a353e service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:59.493990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 860/1755] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:59.531613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a24c22-a3e1-4ffd-97c2-79de69d87df6 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:59.542966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a0a24c22-a3e1-4ffd-97c2-79de69d87df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:59.571382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a24c22-a3e1-4ffd-97c2-79de69d87df6 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:59.582965 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580ccb3-7c12-46c4-84ef-1efe3eb1514c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:59.585117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ccb3-7c12-46c4-84ef-1efe3eb1514c service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:59.585821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ccb3-7c12-46c4-84ef-1efe3eb1514c service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:59.586858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ccb3-7c12-46c4-84ef-1efe3eb1514c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:59.609661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580ccb3-7c12-46c4-84ef-1efe3eb1514c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:59.612578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580ccb3-7c12-46c4-84ef-1efe3eb1514c service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:59.631007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 896/1756] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:00.669961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:01.743772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa94da-1cdf-4539-980a-e7819b1a353e service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:01.746651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8ffa94da-1cdf-4539-980a-e7819b1a353e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:01.794556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa94da-1cdf-4539-980a-e7819b1a353e service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:01.819728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:01.823482 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:01.829195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:01.829195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] PATH_INFO: `/v3/projects/621e2c45022c489f956bdd94f99f0afa` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:01.834499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621e2c45022c489f956bdd94f99f0afa)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:01.863222 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:02.069075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621e2c45022c489f956bdd94f99f0afa', 'request_id': 'req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.085683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621e2c45022c489f956bdd94f99f0afa', 'request_id': 'req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.103794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621e2c45022c489f956bdd94f99f0afa', 'request_id': 'req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.235223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:02.241468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580ccb3-7c12-46c4-84ef-1efe3eb1514c service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:02.242979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-0580ccb3-7c12-46c4-84ef-1efe3eb1514c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:02.245829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] The token cache is being invalidate because project 621e2c45022c489f956bdd94f99f0afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:02.246226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.248013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.251319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 861/1757] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:01 2022] DELETE /identity/v3/projects/621e2c45022c489f956bdd94f99f0afa => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:02.255247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:02.259823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:02.261282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580ccb3-7c12-46c4-84ef-1efe3eb1514c service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:02.389070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:02.392682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:02.393282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:02.393718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] PATH_INFO: `/v3/projects/43fc95147d20410b8541d1381e001dfa` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:02.397498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fc95147d20410b8541d1381e001dfa)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:02.401550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:02.434179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ebb3-3fd3-4173-afde-43d40bbef2b5 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:02.451083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:02.460256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:02.460256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:02.460256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] PATH_INFO: `/v3/users/fa69836f35db4ccfac1320d4dcd8607e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:02.460256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa69836f35db4ccfac1320d4dcd8607e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:02.460256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:02.591622 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fc95147d20410b8541d1381e001dfa', 'request_id': 'req-75ea9b16-97e0-424f-a50c-196076905ae2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.629032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fc95147d20410b8541d1381e001dfa', 'request_id': 'req-75ea9b16-97e0-424f-a50c-196076905ae2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.645375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fc95147d20410b8541d1381e001dfa', 'request_id': 'req-75ea9b16-97e0-424f-a50c-196076905ae2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.738099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa69836f35db4ccfac1320d4dcd8607e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.755153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa69836f35db4ccfac1320d4dcd8607e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.756244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa69836f35db4ccfac1320d4dcd8607e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.801579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa69836f35db4ccfac1320d4dcd8607e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.804019 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa69836f35db4ccfac1320d4dcd8607e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.839286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] The token cache is being invalidate because project 43fc95147d20410b8541d1381e001dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:02.839286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.839286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:02.845810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 897/1758] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:02 2022] DELETE /identity/v3/projects/43fc95147d20410b8541d1381e001dfa => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:02.847204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:02.848814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:02.977649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea9b16-97e0-424f-a50c-196076905ae2 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:02.992178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 862/1759] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:02 2022] DELETE /identity/v3/users/fa69836f35db4ccfac1320d4dcd8607e => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:02.992289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:02.992415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:02.992415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:02.992817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:02.993568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:02.994803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] PATH_INFO: `/v3/projects/73e2017354464dc59654dd1ea05dc4ef` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:03.001003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e2017354464dc59654dd1ea05dc4ef)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:03.006646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:03.176449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b2b5a-2a03-4599-bd18-3296b22cf030 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:03.184751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:03.186357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:03.186357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:03.186357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] PATH_INFO: `/v3/users/401a9222396a4a158ceb46d1da44acef` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:03.189492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=401a9222396a4a158ceb46d1da44acef)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:03.191460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:03.229245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e2017354464dc59654dd1ea05dc4ef', 'request_id': 'req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.240251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e2017354464dc59654dd1ea05dc4ef', 'request_id': 'req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.253885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e2017354464dc59654dd1ea05dc4ef', 'request_id': 'req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.388424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] The token cache is being invalidate because project 73e2017354464dc59654dd1ea05dc4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:03.392119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.392119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.392119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 898/1760] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:02 2022] DELETE /identity/v3/projects/73e2017354464dc59654dd1ea05dc4ef => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:03.396067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:03.397872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:03.433550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '401a9222396a4a158ceb46d1da44acef'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.456290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '401a9222396a4a158ceb46d1da44acef'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.457762 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '401a9222396a4a158ceb46d1da44acef'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.480058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c4318-5ec8-4e77-a3e9-054d3c62fa38 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:03.485911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:03.490885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:03.492149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:03.492866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:03.493465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] PATH_INFO: `/v3/users/7804665fae1f43c9ad89d8ab6a8134f3` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:03.496052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '401a9222396a4a158ceb46d1da44acef'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.496369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7804665fae1f43c9ad89d8ab6a8134f3)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:03.497031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '401a9222396a4a158ceb46d1da44acef'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.498791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:03.609536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 863/1761] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:02 2022] DELETE /identity/v3/users/401a9222396a4a158ceb46d1da44acef => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:03.734904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7804665fae1f43c9ad89d8ab6a8134f3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.810809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7804665fae1f43c9ad89d8ab6a8134f3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.824775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7804665fae1f43c9ad89d8ab6a8134f3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.874611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7804665fae1f43c9ad89d8ab6a8134f3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.875696 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c1dbcca-ba7d-4638-a65b-dcce46a35ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7804665fae1f43c9ad89d8ab6a8134f3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:03.896274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:03.900520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 899/1762] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:03 2022] DELETE /identity/v3/users/7804665fae1f43c9ad89d8ab6a8134f3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:04.439707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:04.441357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:04.693566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0b49-eddb-47bd-822e-9bfb691cab87 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:04.741999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:04.855349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:04.856396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:04.856721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:04.857033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] PATH_INFO: `/v3/projects/36364b26f7a347bfa5808ab0437c452a` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:04.858388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36364b26f7a347bfa5808ab0437c452a)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:04.860406 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:05.022135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36364b26f7a347bfa5808ab0437c452a', 'request_id': 'req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:05.033531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36364b26f7a347bfa5808ab0437c452a', 'request_id': 'req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:05.041594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36364b26f7a347bfa5808ab0437c452a', 'request_id': 'req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:05.144376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] The token cache is being invalidate because project 36364b26f7a347bfa5808ab0437c452a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:05.145602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:05.150115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9723a10b-56d6-4a63-b39d-e7cc97e28c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:05.160160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 864/1763] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:04 2022] DELETE /identity/v3/projects/36364b26f7a347bfa5808ab0437c452a => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:05.165962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0403e8-b0aa-4acd-9827-dba3db2de714 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:05.166890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0403e8-b0aa-4acd-9827-dba3db2de714 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:05.167363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0403e8-b0aa-4acd-9827-dba3db2de714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:05.206897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-eb0403e8-b0aa-4acd-9827-dba3db2de714 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:05.208455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-eb0403e8-b0aa-4acd-9827-dba3db2de714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:05.349629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 900/1764] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:05.362588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb9167-87bf-4c2d-8dce-a9407bfae627 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:05.362588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb9167-87bf-4c2d-8dce-a9407bfae627 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:05.362588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb9167-87bf-4c2d-8dce-a9407bfae627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:05.394005 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-51cb9167-87bf-4c2d-8dce-a9407bfae627 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:05.396177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-51cb9167-87bf-4c2d-8dce-a9407bfae627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:05.425370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 865/1765] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:05.426615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0403e8-b0aa-4acd-9827-dba3db2de714 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:05.449213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0403e8-b0aa-4acd-9827-dba3db2de714 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:05.458994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:05.460303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:05.460816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:05.483334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:05.486848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:05.488328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:05.493701 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:05.500832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:05.545242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 901/1766] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:05:05.546647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb9167-87bf-4c2d-8dce-a9407bfae627 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:05.547646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:05.549540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:05.577930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb9167-87bf-4c2d-8dce-a9407bfae627 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:05.585702 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28daa78-6b5b-4636-b5a8-2b40e2cc73bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:05.586516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28daa78-6b5b-4636-b5a8-2b40e2cc73bd admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:05.586798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28daa78-6b5b-4636-b5a8-2b40e2cc73bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:05.587073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28daa78-6b5b-4636-b5a8-2b40e2cc73bd admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:05.590324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28daa78-6b5b-4636-b5a8-2b40e2cc73bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:05.592945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e1962-3198-409f-8bc8-2676db110fd8 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:05.595728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28daa78-6b5b-4636-b5a8-2b40e2cc73bd admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:05.610599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:05.611513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:05.615357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:05.615357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] PATH_INFO: `/v3/projects/7e5cb3b4ff0e45409d9d8266bff652c0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:05.615357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5cb3b4ff0e45409d9d8266bff652c0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:05.617279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:05.745145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 866/1767] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:05 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:05.746636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28daa78-6b5b-4636-b5a8-2b40e2cc73bd admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:05.749462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e28daa78-6b5b-4636-b5a8-2b40e2cc73bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:05.835349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5cb3b4ff0e45409d9d8266bff652c0', 'request_id': 'req-60b077fb-932d-43bf-afc2-96eaad10d3ea'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:05.897189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5cb3b4ff0e45409d9d8266bff652c0', 'request_id': 'req-60b077fb-932d-43bf-afc2-96eaad10d3ea'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:05.929229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5cb3b4ff0e45409d9d8266bff652c0', 'request_id': 'req-60b077fb-932d-43bf-afc2-96eaad10d3ea'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:06.020114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] The token cache is being invalidate because project 7e5cb3b4ff0e45409d9d8266bff652c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:06.020362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:06.021277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:06.029405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 902/1768] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:05 2022] DELETE /identity/v3/projects/7e5cb3b4ff0e45409d9d8266bff652c0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:06.029405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:06.029405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:06.157201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28daa78-6b5b-4636-b5a8-2b40e2cc73bd admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:06.274121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b077fb-932d-43bf-afc2-96eaad10d3ea admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:06.281524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f763dd-516d-4795-b088-d25d073f7cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:06.282207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f763dd-516d-4795-b088-d25d073f7cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:06.283038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f763dd-516d-4795-b088-d25d073f7cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:06.283375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f763dd-516d-4795-b088-d25d073f7cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:06.284130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f763dd-516d-4795-b088-d25d073f7cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:06.286829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f763dd-516d-4795-b088-d25d073f7cf8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:06.304507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:06.306719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:06.307056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:06.307344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] PATH_INFO: `/v3/projects/ace3ed6857ca47cbb014b71bf5458f82` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:06.308655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace3ed6857ca47cbb014b71bf5458f82)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:06.311930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:06.389849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 903/1769] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:06 2022] POST /identity/v3/users => generated 283 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:06.391313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dca044-e7ac-406b-a246-ca0b9068f561 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:06.391611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dca044-e7ac-406b-a246-ca0b9068f561 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:06.391894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dca044-e7ac-406b-a246-ca0b9068f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:06.422743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b0dca044-e7ac-406b-a246-ca0b9068f561 None None] MFA Rules not processed for user `62b8c8b994e54023933a4ff2ecf68f42`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:06.422743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b0dca044-e7ac-406b-a246-ca0b9068f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:06.506880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace3ed6857ca47cbb014b71bf5458f82', 'request_id': 'req-214e5509-0ec2-4190-951b-ff1d0ff3efaa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:06.524373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace3ed6857ca47cbb014b71bf5458f82', 'request_id': 'req-214e5509-0ec2-4190-951b-ff1d0ff3efaa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:06.525316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 904/1770] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:06.537353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293c16d-3c4c-4009-99fd-cdd5dbe6a628 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:06.537551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293c16d-3c4c-4009-99fd-cdd5dbe6a628 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:06.537813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293c16d-3c4c-4009-99fd-cdd5dbe6a628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:06.540843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace3ed6857ca47cbb014b71bf5458f82', 'request_id': 'req-214e5509-0ec2-4190-951b-ff1d0ff3efaa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:06.563263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-a293c16d-3c4c-4009-99fd-cdd5dbe6a628 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:06.564662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a293c16d-3c4c-4009-99fd-cdd5dbe6a628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:06.698032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 905/1771] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:06.699513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293c16d-3c4c-4009-99fd-cdd5dbe6a628 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:06.713641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293c16d-3c4c-4009-99fd-cdd5dbe6a628 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:06.721317 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4213c81-5d0c-41af-a250-8bdf76d69f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:06.722585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213c81-5d0c-41af-a250-8bdf76d69f80 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:06.722585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213c81-5d0c-41af-a250-8bdf76d69f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:06.722870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213c81-5d0c-41af-a250-8bdf76d69f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:06.723624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4213c81-5d0c-41af-a250-8bdf76d69f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:06.725316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4213c81-5d0c-41af-a250-8bdf76d69f80 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:06.745233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 906/1772] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:06.745233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de75c6-0d26-479f-b179-6daee2cc9901 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:06.746383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de75c6-0d26-479f-b179-6daee2cc9901 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:06.746576 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de75c6-0d26-479f-b179-6daee2cc9901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:06.783996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b6de75c6-0d26-479f-b179-6daee2cc9901 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:06.785317 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b6de75c6-0d26-479f-b179-6daee2cc9901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:06.797037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 907/1773] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:06.797919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de75c6-0d26-479f-b179-6daee2cc9901 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:06.819265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de75c6-0d26-479f-b179-6daee2cc9901 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:06.827885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae7532-885b-423c-a152-d1f4e3086b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:06.829624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae7532-885b-423c-a152-d1f4e3086b65 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:06.830248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae7532-885b-423c-a152-d1f4e3086b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:06.830992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae7532-885b-423c-a152-d1f4e3086b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:06.832126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae7532-885b-423c-a152-d1f4e3086b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:06.834402 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae7532-885b-423c-a152-d1f4e3086b65 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:06.866770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 908/1774] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:06.869095 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae7532-885b-423c-a152-d1f4e3086b65 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:06.926923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae7532-885b-423c-a152-d1f4e3086b65 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:06.950236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0878f9-af2b-48c6-bc91-3e31d8744104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:06.950933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0878f9-af2b-48c6-bc91-3e31d8744104 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:06.951329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0878f9-af2b-48c6-bc91-3e31d8744104 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:06.951633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0878f9-af2b-48c6-bc91-3e31d8744104 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:06.952561 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0878f9-af2b-48c6-bc91-3e31d8744104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:06.952878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0878f9-af2b-48c6-bc91-3e31d8744104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:06.954547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0878f9-af2b-48c6-bc91-3e31d8744104 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:06.994089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 909/1775] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:05:06.995028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0878f9-af2b-48c6-bc91-3e31d8744104 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:06.999495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:07.010693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0878f9-af2b-48c6-bc91-3e31d8744104 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:07.015595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40919e3-5dd1-4009-8b14-880587dcb62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:07.016528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40919e3-5dd1-4009-8b14-880587dcb62f admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:07.016810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40919e3-5dd1-4009-8b14-880587dcb62f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:07.017180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40919e3-5dd1-4009-8b14-880587dcb62f admin admin] PATH_INFO: `/v3/projects/47f674f5679943eabb30c9df3d5abc7c/users/24d180364d6b4692bc3109879348ab68/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:07.066594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40919e3-5dd1-4009-8b14-880587dcb62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f674f5679943eabb30c9df3d5abc7c, user_id=24d180364d6b4692bc3109879348ab68, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:07.066594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40919e3-5dd1-4009-8b14-880587dcb62f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:07.517723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] The token cache is being invalidate because project ace3ed6857ca47cbb014b71bf5458f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:07.518325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:07.519605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:07.522407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 867/1776] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:05 2022] DELETE /identity/v3/projects/ace3ed6857ca47cbb014b71bf5458f82 => generated 0 bytes in 1776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:07.523415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:07.524955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:07.540489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e5509-0ec2-4190-951b-ff1d0ff3efaa admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:07.569108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 910/1777] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:06 2022] PUT /identity/v3/projects/47f674f5679943eabb30c9df3d5abc7c/users/24d180364d6b4692bc3109879348ab68/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:07.571868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be859ba-d62c-40cc-90b6-e0446cef5e49 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:07.571868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be859ba-d62c-40cc-90b6-e0446cef5e49 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:07.571868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be859ba-d62c-40cc-90b6-e0446cef5e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:07.593693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9be859ba-d62c-40cc-90b6-e0446cef5e49 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:07.594924 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9be859ba-d62c-40cc-90b6-e0446cef5e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:07.623313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b1b5b-29d5-43e7-a88a-0af8cc6022ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:07.624516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b1b5b-29d5-43e7-a88a-0af8cc6022ec admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:07.624996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b1b5b-29d5-43e7-a88a-0af8cc6022ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:07.625479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b1b5b-29d5-43e7-a88a-0af8cc6022ec admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:07.626404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b1b5b-29d5-43e7-a88a-0af8cc6022ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:07.629070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b1b5b-29d5-43e7-a88a-0af8cc6022ec admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:07.684301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 911/1778] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:07.685466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046d893-837e-4e39-8def-4bec6aff1169 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:07.685764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046d893-837e-4e39-8def-4bec6aff1169 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:07.686070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046d893-837e-4e39-8def-4bec6aff1169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:07.730043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c046d893-837e-4e39-8def-4bec6aff1169 None None] MFA Rules not processed for user `24d180364d6b4692bc3109879348ab68`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:07.732225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c046d893-837e-4e39-8def-4bec6aff1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:07.781328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 868/1779] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:07 2022] POST /identity/v3/projects => generated 357 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:07.781927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e81d6-1a32-44b8-b0e3-a98ee570a548 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:07.783672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e81d6-1a32-44b8-b0e3-a98ee570a548 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:07.784069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e81d6-1a32-44b8-b0e3-a98ee570a548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:07.832749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ca5e81d6-1a32-44b8-b0e3-a98ee570a548 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:07.838491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 912/1780] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:07.839493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ca5e81d6-1a32-44b8-b0e3-a98ee570a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:07.839745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046d893-837e-4e39-8def-4bec6aff1169 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:07.894323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046d893-837e-4e39-8def-4bec6aff1169 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:08.003475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 869/1781] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:08.005392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e81d6-1a32-44b8-b0e3-a98ee570a548 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:08.008031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ca5e81d6-1a32-44b8-b0e3-a98ee570a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:08.013593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f422fe2-5113-406b-a2cc-ce7f35a04347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:08.014520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f422fe2-5113-406b-a2cc-ce7f35a04347 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.014805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f422fe2-5113-406b-a2cc-ce7f35a04347 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.015084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f422fe2-5113-406b-a2cc-ce7f35a04347 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.024114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f422fe2-5113-406b-a2cc-ce7f35a04347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:08.024114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f422fe2-5113-406b-a2cc-ce7f35a04347 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:08.068371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e81d6-1a32-44b8-b0e3-a98ee570a548 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:08.102484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f86256-3742-44ba-ae78-966187e050d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:08.104135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f86256-3742-44ba-ae78-966187e050d5 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.106240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f86256-3742-44ba-ae78-966187e050d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.106997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f86256-3742-44ba-ae78-966187e050d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.108719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f86256-3742-44ba-ae78-966187e050d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:08.114218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f86256-3742-44ba-ae78-966187e050d5 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:08.183303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 913/1782] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:07 2022] POST /identity/v3/users => generated 279 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:08.184285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f422fe2-5113-406b-a2cc-ce7f35a04347 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:08.212582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f422fe2-5113-406b-a2cc-ce7f35a04347 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:08.226198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d8c73-d65d-47ed-b195-8ed4b4bf68bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:08.227435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d8c73-d65d-47ed-b195-8ed4b4bf68bc admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.227435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d8c73-d65d-47ed-b195-8ed4b4bf68bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.227435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d8c73-d65d-47ed-b195-8ed4b4bf68bc admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.229955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d8c73-d65d-47ed-b195-8ed4b4bf68bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:08.230273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d8c73-d65d-47ed-b195-8ed4b4bf68bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:08.235728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d8c73-d65d-47ed-b195-8ed4b4bf68bc admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:08.273117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 914/1783] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:05:08.277190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d8c73-d65d-47ed-b195-8ed4b4bf68bc admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:08.301395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d8c73-d65d-47ed-b195-8ed4b4bf68bc admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:08.302301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:08.315432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e02ad4-183d-4696-b15d-20115c1fdcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:08.316912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e02ad4-183d-4696-b15d-20115c1fdcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.317331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e02ad4-183d-4696-b15d-20115c1fdcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.317611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e02ad4-183d-4696-b15d-20115c1fdcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.318678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e02ad4-183d-4696-b15d-20115c1fdcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:08.322615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e02ad4-183d-4696-b15d-20115c1fdcf7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:08.352733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 915/1784] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:08.358000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e02ad4-183d-4696-b15d-20115c1fdcf7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:08.384515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e02ad4-183d-4696-b15d-20115c1fdcf7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:08.395641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 870/1785] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:08 2022] POST /identity/v3/projects => generated 365 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:08.397360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f86256-3742-44ba-ae78-966187e050d5 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:08.573243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db157474-553a-4f4f-a162-b11d0f8f9cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:08.574055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db157474-553a-4f4f-a162-b11d0f8f9cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.576747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db157474-553a-4f4f-a162-b11d0f8f9cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.576933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db157474-553a-4f4f-a162-b11d0f8f9cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.577646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db157474-553a-4f4f-a162-b11d0f8f9cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:08.582924 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db157474-553a-4f4f-a162-b11d0f8f9cd5 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:08.603227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f86256-3742-44ba-ae78-966187e050d5 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:08.618582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc97f7-bd68-4fa7-a13e-e843cac31b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:08.620150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc97f7-bd68-4fa7-a13e-e843cac31b90 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.620875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc97f7-bd68-4fa7-a13e-e843cac31b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.621605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc97f7-bd68-4fa7-a13e-e843cac31b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.623482 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc97f7-bd68-4fa7-a13e-e843cac31b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:08.626700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc97f7-bd68-4fa7-a13e-e843cac31b90 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:08.642428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 871/1786] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:08.644714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc97f7-bd68-4fa7-a13e-e843cac31b90 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:08.650422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:08.659917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc97f7-bd68-4fa7-a13e-e843cac31b90 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:08.666663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6842402-814b-4fd6-9f13-add7309d1e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:08.667684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6842402-814b-4fd6-9f13-add7309d1e99 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.668131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6842402-814b-4fd6-9f13-add7309d1e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.668573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6842402-814b-4fd6-9f13-add7309d1e99 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.669407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6842402-814b-4fd6-9f13-add7309d1e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:08.671492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6842402-814b-4fd6-9f13-add7309d1e99 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:08.712221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 916/1787] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:08 2022] POST /identity/v3/projects => generated 409 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:08.713896 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e837f-80fb-46c3-8f3b-2e44a48fd570 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.714252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e837f-80fb-46c3-8f3b-2e44a48fd570 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.714821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e837f-80fb-46c3-8f3b-2e44a48fd570 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.730490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 917/1788] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 17:05:08 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:05:08.732204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e837f-80fb-46c3-8f3b-2e44a48fd570 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:08.754541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 872/1789] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:08 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:08.756660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6842402-814b-4fd6-9f13-add7309d1e99 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:08.793403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6842402-814b-4fd6-9f13-add7309d1e99 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:08.939856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e837f-80fb-46c3-8f3b-2e44a48fd570 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:08.951424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a1f4-de3d-475c-a43c-b1290d32eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:08.953910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80937b3f-1fe7-40ec-87dd-469e44e3ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:08.954292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a1f4-de3d-475c-a43c-b1290d32eb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.954599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80937b3f-1fe7-40ec-87dd-469e44e3ca29 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:08.954883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80937b3f-1fe7-40ec-87dd-469e44e3ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.955158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80937b3f-1fe7-40ec-87dd-469e44e3ca29 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.955336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a1f4-de3d-475c-a43c-b1290d32eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:08.955952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a1f4-de3d-475c-a43c-b1290d32eb1c admin admin] PATH_INFO: `/v3/projects/e8f6e45743cd42c8a5b96a054dfddfb9/users/339acd051fc64517a35389f6de5d71f0/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:08.956065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80937b3f-1fe7-40ec-87dd-469e44e3ca29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:08.957968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80937b3f-1fe7-40ec-87dd-469e44e3ca29 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:09.001907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a1f4-de3d-475c-a43c-b1290d32eb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f6e45743cd42c8a5b96a054dfddfb9, user_id=339acd051fc64517a35389f6de5d71f0, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:09.005647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a1f4-de3d-475c-a43c-b1290d32eb1c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:09.179253 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 918/1790] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:08 2022] PUT /identity/v3/projects/e8f6e45743cd42c8a5b96a054dfddfb9/users/339acd051fc64517a35389f6de5d71f0/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:09.180970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a94df-ee66-4200-8e22-4ef337fed845 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:09.181270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a94df-ee66-4200-8e22-4ef337fed845 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:09.181550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a94df-ee66-4200-8e22-4ef337fed845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:09.183866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 873/1791] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:08 2022] POST /identity/v3/users => generated 305 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:09.185776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80937b3f-1fe7-40ec-87dd-469e44e3ca29 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:09.252946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80937b3f-1fe7-40ec-87dd-469e44e3ca29 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:09.254458 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5a6a94df-ee66-4200-8e22-4ef337fed845 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:09.262305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5a6a94df-ee66-4200-8e22-4ef337fed845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:09.347888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ace33b-ecde-457b-b60a-6b053ba06cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:09.348573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ace33b-ecde-457b-b60a-6b053ba06cfd admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:09.348858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ace33b-ecde-457b-b60a-6b053ba06cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:09.349135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ace33b-ecde-457b-b60a-6b053ba06cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:09.349873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ace33b-ecde-457b-b60a-6b053ba06cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:09.353100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ace33b-ecde-457b-b60a-6b053ba06cfd admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:09.365607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 874/1792] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:09.366604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ace33b-ecde-457b-b60a-6b053ba06cfd admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:09.382299 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ace33b-ecde-457b-b60a-6b053ba06cfd admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:09.388187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880471bf-1306-45f5-a733-c1573be481a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:09.388890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880471bf-1306-45f5-a733-c1573be481a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:09.389617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880471bf-1306-45f5-a733-c1573be481a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:09.389921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880471bf-1306-45f5-a733-c1573be481a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:09.398270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880471bf-1306-45f5-a733-c1573be481a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:09.401947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880471bf-1306-45f5-a733-c1573be481a8 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:09.417608 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 875/1793] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:09.419067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fea50-b2e4-4a1f-9f0a-1004962dbf57 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:09.419365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fea50-b2e4-4a1f-9f0a-1004962dbf57 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:09.419731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fea50-b2e4-4a1f-9f0a-1004962dbf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:09.465956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-135fea50-b2e4-4a1f-9f0a-1004962dbf57 None None] MFA Rules not processed for user `339acd051fc64517a35389f6de5d71f0`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:09.472024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-135fea50-b2e4-4a1f-9f0a-1004962dbf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:09.541724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 919/1794] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:09.542913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a94df-ee66-4200-8e22-4ef337fed845 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:09.569633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a94df-ee66-4200-8e22-4ef337fed845 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:09.585036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875d87d-efd6-4b90-a07f-cef6c990e4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:09.586923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875d87d-efd6-4b90-a07f-cef6c990e4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:09.587102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875d87d-efd6-4b90-a07f-cef6c990e4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:09.587486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875d87d-efd6-4b90-a07f-cef6c990e4ac admin admin] PATH_INFO: `/v3/projects/6a0bda6a25d14ce09f10f427a081306d/users/a9ad6113c7df4bae982c5380f6027aac/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:09.634726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875d87d-efd6-4b90-a07f-cef6c990e4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0bda6a25d14ce09f10f427a081306d, user_id=a9ad6113c7df4bae982c5380f6027aac, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:09.656578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 876/1795] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:09.656578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fea50-b2e4-4a1f-9f0a-1004962dbf57 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:09.657458 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875d87d-efd6-4b90-a07f-cef6c990e4ac admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:09.661047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fea50-b2e4-4a1f-9f0a-1004962dbf57 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:09.668154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5412d0-f92d-4b3e-9757-24abc83aade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:09.669061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5412d0-f92d-4b3e-9757-24abc83aade5 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:09.669518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5412d0-f92d-4b3e-9757-24abc83aade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:09.669971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5412d0-f92d-4b3e-9757-24abc83aade5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:09.670918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5412d0-f92d-4b3e-9757-24abc83aade5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:09.673776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5412d0-f92d-4b3e-9757-24abc83aade5 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:09.708459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 877/1796] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:09.710141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5412d0-f92d-4b3e-9757-24abc83aade5 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:09.716009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2d5412d0-f92d-4b3e-9757-24abc83aade5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:09.736377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5412d0-f92d-4b3e-9757-24abc83aade5 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:09.750952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59ab5-3982-46ec-ba54-b70aaa0c9aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:09.752445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59ab5-3982-46ec-ba54-b70aaa0c9aaa service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:09.753097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59ab5-3982-46ec-ba54-b70aaa0c9aaa service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:09.755271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59ab5-3982-46ec-ba54-b70aaa0c9aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:09.768450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee59ab5-3982-46ec-ba54-b70aaa0c9aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:09.770412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee59ab5-3982-46ec-ba54-b70aaa0c9aaa service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:09.783543 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 920/1797] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:09 2022] PUT /identity/v3/projects/6a0bda6a25d14ce09f10f427a081306d/users/a9ad6113c7df4bae982c5380f6027aac/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:09.784230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875d87d-efd6-4b90-a07f-cef6c990e4ac admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:09.786827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 878/1798] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:09.799241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59ab5-3982-46ec-ba54-b70aaa0c9aaa service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:09.825766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59ab5-3982-46ec-ba54-b70aaa0c9aaa service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:09.966798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875d87d-efd6-4b90-a07f-cef6c990e4ac admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:09.983658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e0ed-6bd2-43c3-b018-1d9dee29041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:09.984742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e0ed-6bd2-43c3-b018-1d9dee29041b admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:09.985329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e0ed-6bd2-43c3-b018-1d9dee29041b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:09.986560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e0ed-6bd2-43c3-b018-1d9dee29041b admin admin] PATH_INFO: `/v3/projects/c934cef1573f4ed492f50bc0373af7e1/users/79023a340fbc47f0b0a3086170cc21a1/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:09.991261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a89023-98e4-48ae-b45f-491b7aeb038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:09.992149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a89023-98e4-48ae-b45f-491b7aeb038a admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:09.992932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a89023-98e4-48ae-b45f-491b7aeb038a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:09.993219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a89023-98e4-48ae-b45f-491b7aeb038a admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:09.994041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a89023-98e4-48ae-b45f-491b7aeb038a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:09.996198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a89023-98e4-48ae-b45f-491b7aeb038a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:10.028209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8e0ed-6bd2-43c3-b018-1d9dee29041b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c934cef1573f4ed492f50bc0373af7e1, user_id=79023a340fbc47f0b0a3086170cc21a1, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:10.031542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8e0ed-6bd2-43c3-b018-1d9dee29041b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:10.118061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 879/1799] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:09 2022] PUT /identity/v3/projects/c934cef1573f4ed492f50bc0373af7e1/users/79023a340fbc47f0b0a3086170cc21a1/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:10.126790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e0ed-6bd2-43c3-b018-1d9dee29041b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:10.168459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 921/1800] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:09 2022] POST /identity/v3/projects => generated 357 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:10.170875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3179f1-db3b-4849-8187-99cbd59e5232 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:10.171763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3179f1-db3b-4849-8187-99cbd59e5232 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:10.172164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3179f1-db3b-4849-8187-99cbd59e5232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:10.231386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1b3179f1-db3b-4849-8187-99cbd59e5232 None None] MFA Rules not processed for user `79023a340fbc47f0b0a3086170cc21a1`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:10.232716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1b3179f1-db3b-4849-8187-99cbd59e5232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:10.353020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e0ed-6bd2-43c3-b018-1d9dee29041b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:10.377772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 922/1801] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:10.378636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3179f1-db3b-4849-8187-99cbd59e5232 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:10.464067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9529b-e924-4108-8a32-8bd22c26c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:10.465477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9529b-e924-4108-8a32-8bd22c26c692 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:10.466066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9529b-e924-4108-8a32-8bd22c26c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:10.472592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9529b-e924-4108-8a32-8bd22c26c692 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:10.473865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9529b-e924-4108-8a32-8bd22c26c692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:10.476304 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9529b-e924-4108-8a32-8bd22c26c692 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:10.506979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 880/1802] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:10.509213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9529b-e924-4108-8a32-8bd22c26c692 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:10.527254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9529b-e924-4108-8a32-8bd22c26c692 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:10.536171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf795-8fe5-4864-9902-06420a173170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:10.537257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf795-8fe5-4864-9902-06420a173170 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:10.537819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf795-8fe5-4864-9902-06420a173170 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:10.538303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf795-8fe5-4864-9902-06420a173170 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:10.539357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf795-8fe5-4864-9902-06420a173170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:10.542427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf795-8fe5-4864-9902-06420a173170 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:10.551866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3179f1-db3b-4849-8187-99cbd59e5232 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:10.559216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c273d-f3ae-46d5-a29b-042725ebc635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:10.559947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c273d-f3ae-46d5-a29b-042725ebc635 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:10.560242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c273d-f3ae-46d5-a29b-042725ebc635 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:10.560679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c273d-f3ae-46d5-a29b-042725ebc635 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:10.561496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c273d-f3ae-46d5-a29b-042725ebc635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:10.563600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c273d-f3ae-46d5-a29b-042725ebc635 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:10.686967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 881/1803] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:10 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:10.686967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf2332-e007-4b2c-bb30-6a18a467f1b5 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:10.686967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf2332-e007-4b2c-bb30-6a18a467f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:10.686967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf2332-e007-4b2c-bb30-6a18a467f1b5 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:10.687996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 923/1804] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:10 2022] POST /identity/v3/users => generated 285 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:10.688572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c273d-f3ae-46d5-a29b-042725ebc635 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:10.694377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 882/1805] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 17:05:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:05:10.695648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf2332-e007-4b2c-bb30-6a18a467f1b5 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:10.701100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c273d-f3ae-46d5-a29b-042725ebc635 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:10.793176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd0815-514a-490f-83a1-a928c6385326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:10.795146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd0815-514a-490f-83a1-a928c6385326 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:10.795419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd0815-514a-490f-83a1-a928c6385326 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:10.795789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd0815-514a-490f-83a1-a928c6385326 admin admin] PATH_INFO: `/v3/projects/6a0bda6a25d14ce09f10f427a081306d/users/a9ad6113c7df4bae982c5380f6027aac/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:10.800148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd0815-514a-490f-83a1-a928c6385326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0bda6a25d14ce09f10f427a081306d, user_id=a9ad6113c7df4bae982c5380f6027aac, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:10.803922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd0815-514a-490f-83a1-a928c6385326 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:10.817740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf2332-e007-4b2c-bb30-6a18a467f1b5 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:10.831103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 924/1806] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:10 2022] PUT /identity/v3/projects/6a0bda6a25d14ce09f10f427a081306d/users/a9ad6113c7df4bae982c5380f6027aac/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:10.832035 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd0815-514a-490f-83a1-a928c6385326 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:10.922930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0c2de-e812-4acb-90d4-bde866eef667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:10.923649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0c2de-e812-4acb-90d4-bde866eef667 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:10.923936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0c2de-e812-4acb-90d4-bde866eef667 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:10.924219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0c2de-e812-4acb-90d4-bde866eef667 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:10.924959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0c2de-e812-4acb-90d4-bde866eef667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:10.926599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0c2de-e812-4acb-90d4-bde866eef667 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:10.955653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 883/1807] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:10.957061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c57a4b-5ae5-4fb5-b443-4c52b2cc5405 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:10.959806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c57a4b-5ae5-4fb5-b443-4c52b2cc5405 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:10.960235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c57a4b-5ae5-4fb5-b443-4c52b2cc5405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.010979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd0815-514a-490f-83a1-a928c6385326 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.017878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c324-e256-45d3-830c-799fe09674b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.017878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c324-e256-45d3-830c-799fe09674b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.017878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c324-e256-45d3-830c-799fe09674b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.017878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c324-e256-45d3-830c-799fe09674b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.024964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0c324-e256-45d3-830c-799fe09674b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.024964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0c324-e256-45d3-830c-799fe09674b5 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.041615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f5c57a4b-5ae5-4fb5-b443-4c52b2cc5405 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:11.046449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f5c57a4b-5ae5-4fb5-b443-4c52b2cc5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:11.150186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 884/1808] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 17:05:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:11.151674 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc49f1-91f4-4f9b-8f70-a8eae3fb206a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.152113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc49f1-91f4-4f9b-8f70-a8eae3fb206a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.152543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc49f1-91f4-4f9b-8f70-a8eae3fb206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.184447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e7dc49f1-91f4-4f9b-8f70-a8eae3fb206a None None] MFA Rules not processed for user `a9ad6113c7df4bae982c5380f6027aac`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:11.185798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e7dc49f1-91f4-4f9b-8f70-a8eae3fb206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:11.268900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 925/1809] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:10 2022] POST /identity/v3/users => generated 311 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:11.273805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c324-e256-45d3-830c-799fe09674b5 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.292018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c324-e256-45d3-830c-799fe09674b5 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.298899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283e3dc-5b94-453d-8968-6a5c62b79249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.300231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e3dc-5b94-453d-8968-6a5c62b79249 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.300741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e3dc-5b94-453d-8968-6a5c62b79249 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.301205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e3dc-5b94-453d-8968-6a5c62b79249 admin admin] PATH_INFO: `/v3/projects/c78270aaab6d4391abc95b5d1ecba3f2/users/3d3a7fea5c174ac09dc8055190633df0/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.308251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 885/1810] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:11.309565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc49f1-91f4-4f9b-8f70-a8eae3fb206a None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.314026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e7dc49f1-91f4-4f9b-8f70-a8eae3fb206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:11.346184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283e3dc-5b94-453d-8968-6a5c62b79249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78270aaab6d4391abc95b5d1ecba3f2, user_id=3d3a7fea5c174ac09dc8055190633df0, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.348716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc49f1-91f4-4f9b-8f70-a8eae3fb206a None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.350470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283e3dc-5b94-453d-8968-6a5c62b79249 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.358992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7ae50-bd53-4e5e-af20-829ae18272cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.360260 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7ae50-bd53-4e5e-af20-829ae18272cd service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.360568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7ae50-bd53-4e5e-af20-829ae18272cd service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.362550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:11.363909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7ae50-bd53-4e5e-af20-829ae18272cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.382520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7ae50-bd53-4e5e-af20-829ae18272cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.386258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7ae50-bd53-4e5e-af20-829ae18272cd service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.407307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 886/1811] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:11.408891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7ae50-bd53-4e5e-af20-829ae18272cd service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.426424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7ae50-bd53-4e5e-af20-829ae18272cd service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.432665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90658a33-beeb-41f0-986e-7cad76fd9aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.433623 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658a33-beeb-41f0-986e-7cad76fd9aaf admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.434169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658a33-beeb-41f0-986e-7cad76fd9aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.434333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658a33-beeb-41f0-986e-7cad76fd9aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.435588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90658a33-beeb-41f0-986e-7cad76fd9aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.437678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90658a33-beeb-41f0-986e-7cad76fd9aaf admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.449777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 887/1812] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:11.450891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90658a33-beeb-41f0-986e-7cad76fd9aaf admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.454405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-90658a33-beeb-41f0-986e-7cad76fd9aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:11.463730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 926/1813] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:11 2022] PUT /identity/v3/projects/c78270aaab6d4391abc95b5d1ecba3f2/users/3d3a7fea5c174ac09dc8055190633df0/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:11.465941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283e3dc-5b94-453d-8968-6a5c62b79249 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.538912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90658a33-beeb-41f0-986e-7cad76fd9aaf admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.543741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:11.584088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283e3dc-5b94-453d-8968-6a5c62b79249 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.594835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e46f0-3c12-48b3-afd3-06616d869a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.595786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e46f0-3c12-48b3-afd3-06616d869a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.596353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e46f0-3c12-48b3-afd3-06616d869a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.596353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e46f0-3c12-48b3-afd3-06616d869a9c admin admin] PATH_INFO: `/v3/projects/58f79424270a4a6ea3fe29be9d278201/users/b0ee00156a2644048e76c4777422e139/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.605256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7e73-ff26-497f-a392-a9d1f541d212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.606876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7e73-ff26-497f-a392-a9d1f541d212 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.607521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7e73-ff26-497f-a392-a9d1f541d212 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.613143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7e73-ff26-497f-a392-a9d1f541d212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.614919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e46f0-3c12-48b3-afd3-06616d869a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f79424270a4a6ea3fe29be9d278201, user_id=b0ee00156a2644048e76c4777422e139, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.618866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e46f0-3c12-48b3-afd3-06616d869a9c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.696082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7e73-ff26-497f-a392-a9d1f541d212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.697763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7e73-ff26-497f-a392-a9d1f541d212 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.716539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 888/1814] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:11.717089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7e73-ff26-497f-a392-a9d1f541d212 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.733295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7e73-ff26-497f-a392-a9d1f541d212 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.741232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52868f74-8c2b-4c0d-8ffe-8a4288e7c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.742646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52868f74-8c2b-4c0d-8ffe-8a4288e7c78d admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.743179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52868f74-8c2b-4c0d-8ffe-8a4288e7c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.743936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52868f74-8c2b-4c0d-8ffe-8a4288e7c78d admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.745305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52868f74-8c2b-4c0d-8ffe-8a4288e7c78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.747941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52868f74-8c2b-4c0d-8ffe-8a4288e7c78d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.752463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 927/1815] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:11 2022] PUT /identity/v3/projects/58f79424270a4a6ea3fe29be9d278201/users/b0ee00156a2644048e76c4777422e139/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:11.758689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e46f0-3c12-48b3-afd3-06616d869a9c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.762476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 889/1816] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:11.770988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52868f74-8c2b-4c0d-8ffe-8a4288e7c78d admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.784960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52868f74-8c2b-4c0d-8ffe-8a4288e7c78d admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.869305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e46f0-3c12-48b3-afd3-06616d869a9c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.873738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9054e66-3061-4935-893e-702254f59242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.874856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9054e66-3061-4935-893e-702254f59242 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.875183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9054e66-3061-4935-893e-702254f59242 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.875596 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9054e66-3061-4935-893e-702254f59242 admin admin] PATH_INFO: `/v3/projects/c78270aaab6d4391abc95b5d1ecba3f2/users/3d3a7fea5c174ac09dc8055190633df0/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.878173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9054e66-3061-4935-893e-702254f59242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78270aaab6d4391abc95b5d1ecba3f2, user_id=3d3a7fea5c174ac09dc8055190633df0, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.881155 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9054e66-3061-4935-893e-702254f59242 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.881295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af1c0-117b-456a-8196-8eb5d0ffd1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.882008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af1c0-117b-456a-8196-8eb5d0ffd1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.882238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af1c0-117b-456a-8196-8eb5d0ffd1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.882634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af1c0-117b-456a-8196-8eb5d0ffd1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.883953 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af1c0-117b-456a-8196-8eb5d0ffd1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.895302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af1c0-117b-456a-8196-8eb5d0ffd1f6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.895495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 890/1817] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:11 2022] PUT /identity/v3/projects/c78270aaab6d4391abc95b5d1ecba3f2/users/3d3a7fea5c174ac09dc8055190633df0/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:11.907048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f276-e753-4760-9b0d-5188ade7f9f6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.909399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f276-e753-4760-9b0d-5188ade7f9f6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.909888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f276-e753-4760-9b0d-5188ade7f9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.920339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 928/1818] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:11.923132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af1c0-117b-456a-8196-8eb5d0ffd1f6 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.948985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af1c0-117b-456a-8196-8eb5d0ffd1f6 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.969097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-08f2f276-e753-4760-9b0d-5188ade7f9f6 None None] MFA Rules not processed for user `3d3a7fea5c174ac09dc8055190633df0`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:11.970661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-08f2f276-e753-4760-9b0d-5188ade7f9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:12.054634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d3235-fdd7-4d32-b838-da885eec7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:12.056371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d3235-fdd7-4d32-b838-da885eec7127 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:12.056921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d3235-fdd7-4d32-b838-da885eec7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:12.058274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d3235-fdd7-4d32-b838-da885eec7127 admin admin] PATH_INFO: `/v3/projects/58f79424270a4a6ea3fe29be9d278201/users/b0ee00156a2644048e76c4777422e139/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:12.060901 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d3235-fdd7-4d32-b838-da885eec7127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f79424270a4a6ea3fe29be9d278201, user_id=b0ee00156a2644048e76c4777422e139, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:12.064399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d3235-fdd7-4d32-b838-da885eec7127 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:12.084497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 929/1819] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:11 2022] PUT /identity/v3/projects/58f79424270a4a6ea3fe29be9d278201/users/b0ee00156a2644048e76c4777422e139/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:12.100899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d3235-fdd7-4d32-b838-da885eec7127 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:12.134126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 891/1820] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:11 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:12.135883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815e34-33c7-492d-afed-90bf7d039960 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:12.136285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815e34-33c7-492d-afed-90bf7d039960 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:12.136670 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815e34-33c7-492d-afed-90bf7d039960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:12.191026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-32815e34-33c7-492d-afed-90bf7d039960 None None] MFA Rules not processed for user `b0ee00156a2644048e76c4777422e139`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:12.194640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-32815e34-33c7-492d-afed-90bf7d039960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:12.194775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d3235-fdd7-4d32-b838-da885eec7127 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:12.199288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1415bd9-896d-4f87-b941-512026b71e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:12.199987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415bd9-896d-4f87-b941-512026b71e3e service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:12.200274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415bd9-896d-4f87-b941-512026b71e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:12.200553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415bd9-896d-4f87-b941-512026b71e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:12.298421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1415bd9-896d-4f87-b941-512026b71e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:12.300153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1415bd9-896d-4f87-b941-512026b71e3e service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:12.324514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 930/1821] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:12.324514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1415bd9-896d-4f87-b941-512026b71e3e service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:12.324514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b1415bd9-896d-4f87-b941-512026b71e3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:12.333657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1415bd9-896d-4f87-b941-512026b71e3e service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:12.339001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 892/1822] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:12.343459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf686f6-187e-41d2-8315-7045bac381d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:12.344226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf686f6-187e-41d2-8315-7045bac381d6 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:12.344559 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf686f6-187e-41d2-8315-7045bac381d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:12.345042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf686f6-187e-41d2-8315-7045bac381d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:12.481853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf686f6-187e-41d2-8315-7045bac381d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:12.484102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf686f6-187e-41d2-8315-7045bac381d6 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:12.499418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 931/1823] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:12 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:12.668079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32815e34-33c7-492d-afed-90bf7d039960 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:12.689638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32815e34-33c7-492d-afed-90bf7d039960 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:12.709357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c1a8-76f7-4670-a859-404eebc6b671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:12.710289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c1a8-76f7-4670-a859-404eebc6b671 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:12.711939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c1a8-76f7-4670-a859-404eebc6b671 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:12.712352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c1a8-76f7-4670-a859-404eebc6b671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:12.752712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7c1a8-76f7-4670-a859-404eebc6b671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:12.754943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7c1a8-76f7-4670-a859-404eebc6b671 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:12.772747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 893/1824] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:12 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:13.048039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf686f6-187e-41d2-8315-7045bac381d6 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:13.058075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf686f6-187e-41d2-8315-7045bac381d6 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:13.064395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e46dc-f8ae-4799-bdef-8f53009382d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:13.065072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e46dc-f8ae-4799-bdef-8f53009382d4 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:13.065353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e46dc-f8ae-4799-bdef-8f53009382d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:13.065627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e46dc-f8ae-4799-bdef-8f53009382d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:13.132937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e46dc-f8ae-4799-bdef-8f53009382d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:13.134540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e46dc-f8ae-4799-bdef-8f53009382d4 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:13.145062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 932/1825] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:13 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:13.256441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c1a8-76f7-4670-a859-404eebc6b671 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:13.265537 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c1a8-76f7-4670-a859-404eebc6b671 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:13.269271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425d2ad-ceb1-4793-89aa-62302ebb9ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:13.269908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d2ad-ceb1-4793-89aa-62302ebb9ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:13.270190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d2ad-ceb1-4793-89aa-62302ebb9ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:13.270468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d2ad-ceb1-4793-89aa-62302ebb9ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:13.336989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425d2ad-ceb1-4793-89aa-62302ebb9ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:13.338457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425d2ad-ceb1-4793-89aa-62302ebb9ed8 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:13.349035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 894/1826] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:13.787778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:13.935810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:17.056831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:17.207696 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:18.073657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e46dc-f8ae-4799-bdef-8f53009382d4 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:18.167203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e46dc-f8ae-4799-bdef-8f53009382d4 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:18.172684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:18.173684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:18.173965 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:18.177687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] PATH_INFO: `/v3/users/24d180364d6b4692bc3109879348ab68` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:18.177687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d180364d6b4692bc3109879348ab68)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:18.181380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:18.455692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d180364d6b4692bc3109879348ab68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:18.558544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d180364d6b4692bc3109879348ab68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:18.567385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d180364d6b4692bc3109879348ab68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:18.605835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d180364d6b4692bc3109879348ab68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:18.606606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d180364d6b4692bc3109879348ab68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:18.629585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 933/1827] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:18 2022] DELETE /identity/v3/users/24d180364d6b4692bc3109879348ab68 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:18.631401 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c241-4a27-4d53-9d2a-f227d227425a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:18.631933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c241-4a27-4d53-9d2a-f227d227425a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:18.632329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c241-4a27-4d53-9d2a-f227d227425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:18.665972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ae77c241-4a27-4d53-9d2a-f227d227425a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:18.668561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ae77c241-4a27-4d53-9d2a-f227d227425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:18.856094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 895/1828] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:18.904672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:18.907221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:19.063902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d62e69-15cd-44db-ac92-c35fc3d39c09 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:19.084608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1951b-cb52-42c8-831a-db1819147c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:19.085297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1951b-cb52-42c8-831a-db1819147c52 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:19.085588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1951b-cb52-42c8-831a-db1819147c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:19.086512 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1951b-cb52-42c8-831a-db1819147c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:19.130589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1951b-cb52-42c8-831a-db1819147c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:19.132291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1951b-cb52-42c8-831a-db1819147c52 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:19.153392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 934/1829] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:19.284803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:20.118401 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c241-4a27-4d53-9d2a-f227d227425a None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:20.120093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ae77c241-4a27-4d53-9d2a-f227d227425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:20.223549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c241-4a27-4d53-9d2a-f227d227425a None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:20.229004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:20.229935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:20.230221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:20.230497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] PATH_INFO: `/v3/projects/47f674f5679943eabb30c9df3d5abc7c` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:20.231800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f674f5679943eabb30c9df3d5abc7c)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:20.234933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:20.401941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f674f5679943eabb30c9df3d5abc7c', 'request_id': 'req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:20.416406 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f674f5679943eabb30c9df3d5abc7c', 'request_id': 'req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:20.422913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f674f5679943eabb30c9df3d5abc7c', 'request_id': 'req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:20.531625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] The token cache is being invalidate because project 47f674f5679943eabb30c9df3d5abc7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:20.532071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:20.533456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:20.542300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 896/1830] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:20 2022] DELETE /identity/v3/projects/47f674f5679943eabb30c9df3d5abc7c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:20.546519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1951b-cb52-42c8-831a-db1819147c52 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:20.604217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1951b-cb52-42c8-831a-db1819147c52 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:20.661530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:20.667486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:20.668398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:20.669136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:20.669136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] PATH_INFO: `/v3/users/a9ad6113c7df4bae982c5380f6027aac` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:20.670137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ad6113c7df4bae982c5380f6027aac)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:20.672110 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:20.910755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ad6113c7df4bae982c5380f6027aac'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:21.005519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ad6113c7df4bae982c5380f6027aac'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:21.016163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ad6113c7df4bae982c5380f6027aac'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:21.029777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ad6113c7df4bae982c5380f6027aac'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:21.030775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ad6113c7df4bae982c5380f6027aac'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:21.037584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 935/1831] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:20 2022] DELETE /identity/v3/users/a9ad6113c7df4bae982c5380f6027aac => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:21.642570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:21.645368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:21.679056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93ae3-3793-4c7a-8bdc-938e17781fbb admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:21.781835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:21.782961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:21.783241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:21.783731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] PATH_INFO: `/v3/projects/6a0bda6a25d14ce09f10f427a081306d` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:21.785037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0bda6a25d14ce09f10f427a081306d)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:21.787057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:21.847715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:21.849174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:21.864674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dd5ae-27d7-499b-b9bd-f582d1013264 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:21.871129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:21.872150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:21.872435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:21.872713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] PATH_INFO: `/v3/users/79023a340fbc47f0b0a3086170cc21a1` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:21.874107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79023a340fbc47f0b0a3086170cc21a1)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:21.876287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:21.908404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0bda6a25d14ce09f10f427a081306d', 'request_id': 'req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:21.915080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0bda6a25d14ce09f10f427a081306d', 'request_id': 'req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:21.921288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0bda6a25d14ce09f10f427a081306d', 'request_id': 'req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:22.055676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] The token cache is being invalidate because project 6a0bda6a25d14ce09f10f427a081306d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:22.056061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:22.056788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-c7db7a8e-ce11-4218-a89e-f3a46fe75d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:22.061827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 897/1832] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:21 2022] DELETE /identity/v3/projects/6a0bda6a25d14ce09f10f427a081306d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:22.063386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfcc50-cd03-4317-97ca-e85d243fb1d9 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.063707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfcc50-cd03-4317-97ca-e85d243fb1d9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.063987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfcc50-cd03-4317-97ca-e85d243fb1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:22.113121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d1bfcc50-cd03-4317-97ca-e85d243fb1d9 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:22.114467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d1bfcc50-cd03-4317-97ca-e85d243fb1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:22.128183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79023a340fbc47f0b0a3086170cc21a1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:22.179609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 898/1833] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:22.190111 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cfc1b-7223-44f6-8e29-9040b6ed7910 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.190501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cfc1b-7223-44f6-8e29-9040b6ed7910 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.190998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cfc1b-7223-44f6-8e29-9040b6ed7910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:22.209729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79023a340fbc47f0b0a3086170cc21a1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:22.212616 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b52cfc1b-7223-44f6-8e29-9040b6ed7910 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:22.213015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b52cfc1b-7223-44f6-8e29-9040b6ed7910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:22.218922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79023a340fbc47f0b0a3086170cc21a1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:22.221338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 899/1834] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:22.225618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cfc1b-7223-44f6-8e29-9040b6ed7910 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:22.233361 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79023a340fbc47f0b0a3086170cc21a1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:22.234169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bcf82397-092e-4ba2-9f42-191cf018bb8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79023a340fbc47f0b0a3086170cc21a1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:22.235839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cfc1b-7223-44f6-8e29-9040b6ed7910 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:22.240828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:22.241563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.247431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.247431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:22.247431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:22.247431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:22.247431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:22.248060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 936/1835] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:21 2022] DELETE /identity/v3/users/79023a340fbc47f0b0a3086170cc21a1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:22.251014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a062d3e-f365-4d38-b818-e22a4f494d3a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.251484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a062d3e-f365-4d38-b818-e22a4f494d3a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.252039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a062d3e-f365-4d38-b818-e22a4f494d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:22.262576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 900/1836] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:05:22.266604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:22.268481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:22.275479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1a062d3e-f365-4d38-b818-e22a4f494d3a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:22.278135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1a062d3e-f365-4d38-b818-e22a4f494d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:22.283468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4b016-85d4-41dc-883f-edc1b1d737f1 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:22.345265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 937/1837] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:22.347391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43750354-f1c1-4bed-a123-5d04c87df6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:22.348096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43750354-f1c1-4bed-a123-5d04c87df6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.348921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43750354-f1c1-4bed-a123-5d04c87df6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.348921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43750354-f1c1-4bed-a123-5d04c87df6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:22.349502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43750354-f1c1-4bed-a123-5d04c87df6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:22.351496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43750354-f1c1-4bed-a123-5d04c87df6d4 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:22.354889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a062d3e-f365-4d38-b818-e22a4f494d3a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:22.356329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1a062d3e-f365-4d38-b818-e22a4f494d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:22.451018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 901/1838] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:22 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:22.454932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43750354-f1c1-4bed-a123-5d04c87df6d4 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:22.524888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a062d3e-f365-4d38-b818-e22a4f494d3a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:22.598289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43750354-f1c1-4bed-a123-5d04c87df6d4 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:22.603439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badfe6f-71d1-49aa-80a4-488e438e7026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:22.605013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badfe6f-71d1-49aa-80a4-488e438e7026 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.605474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badfe6f-71d1-49aa-80a4-488e438e7026 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.605851 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badfe6f-71d1-49aa-80a4-488e438e7026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:22.612155 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0e4ce-99dd-4e13-b94c-88dd82cd2070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:22.612864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0e4ce-99dd-4e13-b94c-88dd82cd2070 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.613148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0e4ce-99dd-4e13-b94c-88dd82cd2070 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.613421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0e4ce-99dd-4e13-b94c-88dd82cd2070 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:22.614140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0e4ce-99dd-4e13-b94c-88dd82cd2070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:22.616187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0e4ce-99dd-4e13-b94c-88dd82cd2070 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:22.624601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badfe6f-71d1-49aa-80a4-488e438e7026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:22.626541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badfe6f-71d1-49aa-80a4-488e438e7026 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:22.646850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 938/1839] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:22.764780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 902/1840] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:22 2022] POST /identity/v3/users => generated 291 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:22.774915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badfe6f-71d1-49aa-80a4-488e438e7026 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:22.775621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:22.807860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badfe6f-71d1-49aa-80a4-488e438e7026 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:22.827961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4d3a-c6a2-4ef4-8603-ec6d3d8d5829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:22.828851 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4d3a-c6a2-4ef4-8603-ec6d3d8d5829 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.829134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4d3a-c6a2-4ef4-8603-ec6d3d8d5829 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.829861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4d3a-c6a2-4ef4-8603-ec6d3d8d5829 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:22.830622 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c4d3a-c6a2-4ef4-8603-ec6d3d8d5829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:22.832277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c4d3a-c6a2-4ef4-8603-ec6d3d8d5829 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:22.853754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 939/1841] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:22.857469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0e4ce-99dd-4e13-b94c-88dd82cd2070 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:22.871553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0e4ce-99dd-4e13-b94c-88dd82cd2070 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:22.885687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f91ca9-7809-4f24-9119-708b8f621f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:22.886636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f91ca9-7809-4f24-9119-708b8f621f07 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.886904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f91ca9-7809-4f24-9119-708b8f621f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.887183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f91ca9-7809-4f24-9119-708b8f621f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:22.888048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f91ca9-7809-4f24-9119-708b8f621f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:22.892306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f91ca9-7809-4f24-9119-708b8f621f07 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:22.919460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 903/1842] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:05:22.919674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4d3a-c6a2-4ef4-8603-ec6d3d8d5829 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:22.937958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4d3a-c6a2-4ef4-8603-ec6d3d8d5829 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:22.953943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a93e52-64c1-4546-8470-a4bbe687bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:22.955053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a93e52-64c1-4546-8470-a4bbe687bd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:22.955343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a93e52-64c1-4546-8470-a4bbe687bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:22.957065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a93e52-64c1-4546-8470-a4bbe687bd2f admin admin] PATH_INFO: `/v3/projects/00cdd873e7be4800a1134bd9ec51bef1/users/646e1ee67568440994eb6e0e8a7833d3/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:23.017295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a93e52-64c1-4546-8470-a4bbe687bd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cdd873e7be4800a1134bd9ec51bef1, user_id=646e1ee67568440994eb6e0e8a7833d3, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:23.020224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a93e52-64c1-4546-8470-a4bbe687bd2f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:23.142753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 940/1843] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:22 2022] PUT /identity/v3/projects/00cdd873e7be4800a1134bd9ec51bef1/users/646e1ee67568440994eb6e0e8a7833d3/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:23.158540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d262-9c4b-484f-af6a-8f20633b8e3e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:23.158890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d262-9c4b-484f-af6a-8f20633b8e3e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:23.159170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d262-9c4b-484f-af6a-8f20633b8e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:23.200848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-2ff0d262-9c4b-484f-af6a-8f20633b8e3e None None] MFA Rules not processed for user `646e1ee67568440994eb6e0e8a7833d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:23.202937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2ff0d262-9c4b-484f-af6a-8f20633b8e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:23.366715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 904/1844] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:23.366833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a93e52-64c1-4546-8470-a4bbe687bd2f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:23.438017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a93e52-64c1-4546-8470-a4bbe687bd2f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:23.445828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c309bc5-3216-49ce-932b-20a282c4d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:23.446436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c309bc5-3216-49ce-932b-20a282c4d43c admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:23.446957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c309bc5-3216-49ce-932b-20a282c4d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:23.447328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c309bc5-3216-49ce-932b-20a282c4d43c admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:23.448262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c309bc5-3216-49ce-932b-20a282c4d43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:23.450296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c309bc5-3216-49ce-932b-20a282c4d43c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:23.621185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 941/1845] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:23 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:23.622661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d262-9c4b-484f-af6a-8f20633b8e3e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:23.634027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d262-9c4b-484f-af6a-8f20633b8e3e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:23.693267 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7893e-3d40-4338-9fab-2a2601ad36e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:23.693983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7893e-3d40-4338-9fab-2a2601ad36e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:23.694264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7893e-3d40-4338-9fab-2a2601ad36e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:23.694536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7893e-3d40-4338-9fab-2a2601ad36e1 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:23.695307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7893e-3d40-4338-9fab-2a2601ad36e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:23.697338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7893e-3d40-4338-9fab-2a2601ad36e1 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:23.825057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c309bc5-3216-49ce-932b-20a282c4d43c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:23.827046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3c309bc5-3216-49ce-932b-20a282c4d43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:23.842664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c309bc5-3216-49ce-932b-20a282c4d43c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:23.858408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:23.866371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:23.866371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:23.866371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] PATH_INFO: `/v3/projects/c934cef1573f4ed492f50bc0373af7e1` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:23.866656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c934cef1573f4ed492f50bc0373af7e1)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:23.869971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:23.888787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 905/1846] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:23 2022] POST /identity/v3/users => generated 298 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:23.892782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7893e-3d40-4338-9fab-2a2601ad36e1 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:23.912536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7893e-3d40-4338-9fab-2a2601ad36e1 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:23.919857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a82412-e6d5-4e19-ab6b-f781038cb5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:23.920842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a82412-e6d5-4e19-ab6b-f781038cb5db admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:23.921132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a82412-e6d5-4e19-ab6b-f781038cb5db admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:23.921683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a82412-e6d5-4e19-ab6b-f781038cb5db admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:23.922457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a82412-e6d5-4e19-ab6b-f781038cb5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:23.924148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a82412-e6d5-4e19-ab6b-f781038cb5db admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:23.936615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 906/1847] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:23.940770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a82412-e6d5-4e19-ab6b-f781038cb5db admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:23.963719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a82412-e6d5-4e19-ab6b-f781038cb5db admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:23.975340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e1c36-57b4-4e36-99f8-d73eb2de0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:23.977810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e1c36-57b4-4e36-99f8-d73eb2de0107 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:23.978173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e1c36-57b4-4e36-99f8-d73eb2de0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:23.978673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e1c36-57b4-4e36-99f8-d73eb2de0107 admin admin] PATH_INFO: `/v3/projects/7692c194ffbc4527859ef345de58e62d/users/639563f1d9fd438c8b9591b842c08a69/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:23.998572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e1c36-57b4-4e36-99f8-d73eb2de0107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7692c194ffbc4527859ef345de58e62d, user_id=639563f1d9fd438c8b9591b842c08a69, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:24.016145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e1c36-57b4-4e36-99f8-d73eb2de0107 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:24.016624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c934cef1573f4ed492f50bc0373af7e1', 'request_id': 'req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.021683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:24.028229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c934cef1573f4ed492f50bc0373af7e1', 'request_id': 'req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.037113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c934cef1573f4ed492f50bc0373af7e1', 'request_id': 'req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.143702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] The token cache is being invalidate because project c934cef1573f4ed492f50bc0373af7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:24.143958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.144713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 907/1848] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:23 2022] PUT /identity/v3/projects/7692c194ffbc4527859ef345de58e62d/users/639563f1d9fd438c8b9591b842c08a69/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:24.145310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.148745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 942/1849] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:23 2022] DELETE /identity/v3/projects/c934cef1573f4ed492f50bc0373af7e1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:24.152330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e1c36-57b4-4e36-99f8-d73eb2de0107 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:24.153338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:24.155064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-529e1c36-57b4-4e36-99f8-d73eb2de0107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:24.157027 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:24.253345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991a9a-1d6d-42e1-83b5-e35fd1672d62 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:24.255948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e1c36-57b4-4e36-99f8-d73eb2de0107 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:24.261992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:24.263195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:24.263615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:24.264001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] PATH_INFO: `/v3/users/b0ee00156a2644048e76c4777422e139` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:24.265393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeb6f2-95b4-44d6-95a6-e24de30d48c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:24.265719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeb6f2-95b4-44d6-95a6-e24de30d48c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:24.265852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ee00156a2644048e76c4777422e139)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:24.266000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeb6f2-95b4-44d6-95a6-e24de30d48c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:24.266340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeb6f2-95b4-44d6-95a6-e24de30d48c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:24.267078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeb6f2-95b4-44d6-95a6-e24de30d48c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:24.268667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:24.268809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeb6f2-95b4-44d6-95a6-e24de30d48c6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:24.281911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 908/1850] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:05:24.286512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeb6f2-95b4-44d6-95a6-e24de30d48c6 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:24.302154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeb6f2-95b4-44d6-95a6-e24de30d48c6 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:24.305655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aea4c-411c-4293-826d-3f7c5c8304e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:24.306533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aea4c-411c-4293-826d-3f7c5c8304e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:24.306810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aea4c-411c-4293-826d-3f7c5c8304e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:24.307084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aea4c-411c-4293-826d-3f7c5c8304e9 admin admin] PATH_INFO: `/v3/projects/7692c194ffbc4527859ef345de58e62d/users/639563f1d9fd438c8b9591b842c08a69/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:24.309093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aea4c-411c-4293-826d-3f7c5c8304e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7692c194ffbc4527859ef345de58e62d, user_id=639563f1d9fd438c8b9591b842c08a69, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:24.312095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aea4c-411c-4293-826d-3f7c5c8304e9 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:24.324588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 909/1851] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:24 2022] PUT /identity/v3/projects/7692c194ffbc4527859ef345de58e62d/users/639563f1d9fd438c8b9591b842c08a69/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:24.337359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b100-0a09-4246-a661-fdb91ccb82f0 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:24.337744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b100-0a09-4246-a661-fdb91ccb82f0 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:24.339014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b100-0a09-4246-a661-fdb91ccb82f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:24.368159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-6098b100-0a09-4246-a661-fdb91ccb82f0 None None] MFA Rules not processed for user `639563f1d9fd438c8b9591b842c08a69`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:24.369374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6098b100-0a09-4246-a661-fdb91ccb82f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:24.476259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 910/1852] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:24.491719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b100-0a09-4246-a661-fdb91ccb82f0 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:24.493353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6098b100-0a09-4246-a661-fdb91ccb82f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:24.538101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ee00156a2644048e76c4777422e139'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.561390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b100-0a09-4246-a661-fdb91ccb82f0 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:24.565146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cb41b-3d8c-4cc0-bd7e-79a99db3c16b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:24.565788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cb41b-3d8c-4cc0-bd7e-79a99db3c16b service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:24.566209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cb41b-3d8c-4cc0-bd7e-79a99db3c16b service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:24.566495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cb41b-3d8c-4cc0-bd7e-79a99db3c16b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:24.576256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cb41b-3d8c-4cc0-bd7e-79a99db3c16b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:24.577776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cb41b-3d8c-4cc0-bd7e-79a99db3c16b service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:24.587902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 911/1853] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:24.637155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ee00156a2644048e76c4777422e139'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.647087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ee00156a2644048e76c4777422e139'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.658761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ee00156a2644048e76c4777422e139'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.659986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ee00156a2644048e76c4777422e139'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:24.666892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 943/1854] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:24 2022] DELETE /identity/v3/users/b0ee00156a2644048e76c4777422e139 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:24.692971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cb41b-3d8c-4cc0-bd7e-79a99db3c16b service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:24.701812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cb41b-3d8c-4cc0-bd7e-79a99db3c16b service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:24.754308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62036d76-74cd-433a-9043-d4286cb3c87a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:24.754962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62036d76-74cd-433a-9043-d4286cb3c87a service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:24.755247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62036d76-74cd-433a-9043-d4286cb3c87a service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:24.755522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62036d76-74cd-433a-9043-d4286cb3c87a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:24.758151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-62036d76-74cd-433a-9043-d4286cb3c87a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:24.823715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62036d76-74cd-433a-9043-d4286cb3c87a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:24.823976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62036d76-74cd-433a-9043-d4286cb3c87a service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:24.833195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 912/1855] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:25.200127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:25.203699 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:25.291734 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9ae7-7505-4fd3-ae27-42aeb05ab57c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:25.296739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:25.298326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:25.298619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:25.298967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] PATH_INFO: `/v3/projects/58f79424270a4a6ea3fe29be9d278201` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:25.300236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f79424270a4a6ea3fe29be9d278201)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:25.302135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:25.440429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f79424270a4a6ea3fe29be9d278201', 'request_id': 'req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:25.447530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f79424270a4a6ea3fe29be9d278201', 'request_id': 'req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:25.454192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f79424270a4a6ea3fe29be9d278201', 'request_id': 'req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:25.569442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] The token cache is being invalidate because project 58f79424270a4a6ea3fe29be9d278201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:25.569868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:25.570776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-451d0449-bdeb-45d5-a0e3-a112f1c4aa54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:25.574254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 944/1856] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:25 2022] DELETE /identity/v3/projects/58f79424270a4a6ea3fe29be9d278201 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:25.580122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1025a-bc58-490c-80e0-6d253beba767 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:25.580523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1025a-bc58-490c-80e0-6d253beba767 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:25.580709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1025a-bc58-490c-80e0-6d253beba767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:25.612161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-91f1025a-bc58-490c-80e0-6d253beba767 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:25.612161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-91f1025a-bc58-490c-80e0-6d253beba767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:25.699202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 913/1857] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:25.705529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:25.707389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59e82a-9a27-4a8e-8df9-5b441a2151f2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:25.707884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59e82a-9a27-4a8e-8df9-5b441a2151f2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:25.708179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59e82a-9a27-4a8e-8df9-5b441a2151f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:25.731414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-bc59e82a-9a27-4a8e-8df9-5b441a2151f2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:25.732986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bc59e82a-9a27-4a8e-8df9-5b441a2151f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:25.742215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 945/1858] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:25.746749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1025a-bc58-490c-80e0-6d253beba767 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:25.757074 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1025a-bc58-490c-80e0-6d253beba767 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:25.762429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5bfda-2fb0-4699-8075-1e928e9648a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:25.763086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5bfda-2fb0-4699-8075-1e928e9648a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:25.763368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5bfda-2fb0-4699-8075-1e928e9648a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:25.763672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5bfda-2fb0-4699-8075-1e928e9648a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:25.764407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5bfda-2fb0-4699-8075-1e928e9648a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:25.764708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5bfda-2fb0-4699-8075-1e928e9648a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:25.766372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5bfda-2fb0-4699-8075-1e928e9648a3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:25.779633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 914/1859] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:05:25.784680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59e82a-9a27-4a8e-8df9-5b441a2151f2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:25.795388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59e82a-9a27-4a8e-8df9-5b441a2151f2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:25.800444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed43741-b686-4c15-bb3c-2e6bb1d2591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:25.801147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed43741-b686-4c15-bb3c-2e6bb1d2591e admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:25.801458 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed43741-b686-4c15-bb3c-2e6bb1d2591e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:25.801893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed43741-b686-4c15-bb3c-2e6bb1d2591e admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:25.802697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed43741-b686-4c15-bb3c-2e6bb1d2591e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:25.804731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed43741-b686-4c15-bb3c-2e6bb1d2591e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:25.995763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 946/1860] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:25 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:25.999737 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5bfda-2fb0-4699-8075-1e928e9648a3 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:26.021430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5bfda-2fb0-4699-8075-1e928e9648a3 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:26.085430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec591-09fb-471d-a7d1-98383588766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:26.086646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec591-09fb-471d-a7d1-98383588766f admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:26.086928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec591-09fb-471d-a7d1-98383588766f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:26.087202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec591-09fb-471d-a7d1-98383588766f admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:26.087924 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ec591-09fb-471d-a7d1-98383588766f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:26.090048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ec591-09fb-471d-a7d1-98383588766f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:26.193149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 915/1861] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:25 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:26.198199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed43741-b686-4c15-bb3c-2e6bb1d2591e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:26.209265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed43741-b686-4c15-bb3c-2e6bb1d2591e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:26.214895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0b29d-2dc5-49c6-b175-4d6c5047f2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:26.215616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0b29d-2dc5-49c6-b175-4d6c5047f2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:26.215898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0b29d-2dc5-49c6-b175-4d6c5047f2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:26.216172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0b29d-2dc5-49c6-b175-4d6c5047f2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:26.217223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0b29d-2dc5-49c6-b175-4d6c5047f2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:26.218995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0b29d-2dc5-49c6-b175-4d6c5047f2d1 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:26.236112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 947/1862] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:26.236789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec591-09fb-471d-a7d1-98383588766f admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:26.250472 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec591-09fb-471d-a7d1-98383588766f admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:26.255716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0d36c-6ae3-4340-a529-147efab4ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:26.256800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0d36c-6ae3-4340-a529-147efab4ee99 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:26.256800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0d36c-6ae3-4340-a529-147efab4ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:26.256984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0d36c-6ae3-4340-a529-147efab4ee99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:26.258228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0d36c-6ae3-4340-a529-147efab4ee99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:26.260148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0d36c-6ae3-4340-a529-147efab4ee99 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:26.273781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 916/1863] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:05:26.280403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0b29d-2dc5-49c6-b175-4d6c5047f2d1 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:26.290754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0b29d-2dc5-49c6-b175-4d6c5047f2d1 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:26.298765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49ac11-2ca6-4728-9712-b8802cc32dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:26.299805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49ac11-2ca6-4728-9712-b8802cc32dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:26.300186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49ac11-2ca6-4728-9712-b8802cc32dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:26.300563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49ac11-2ca6-4728-9712-b8802cc32dd6 admin admin] PATH_INFO: `/v3/projects/c1466f1e10a64bb2901cacaefedcf41a/users/8358ea0b1ec94a67a38eb88643dd1d1c/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:26.323101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49ac11-2ca6-4728-9712-b8802cc32dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1466f1e10a64bb2901cacaefedcf41a, user_id=8358ea0b1ec94a67a38eb88643dd1d1c, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:26.326048 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49ac11-2ca6-4728-9712-b8802cc32dd6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:26.405141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 948/1864] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:26 2022] PUT /identity/v3/projects/c1466f1e10a64bb2901cacaefedcf41a/users/8358ea0b1ec94a67a38eb88643dd1d1c/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:26.412194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b44fe-ef14-48b9-bfea-22ba1ebdce3e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:26.412504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b44fe-ef14-48b9-bfea-22ba1ebdce3e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:26.412761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b44fe-ef14-48b9-bfea-22ba1ebdce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:26.431179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e50b44fe-ef14-48b9-bfea-22ba1ebdce3e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:26.432889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e50b44fe-ef14-48b9-bfea-22ba1ebdce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:26.512078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 917/1865] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:26.520577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49ac11-2ca6-4728-9712-b8802cc32dd6 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:26.523252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-aa49ac11-2ca6-4728-9712-b8802cc32dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:26.596209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49ac11-2ca6-4728-9712-b8802cc32dd6 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:26.600530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28833c-483c-44bf-a9db-551218af5132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:26.601828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28833c-483c-44bf-a9db-551218af5132 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:26.602172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28833c-483c-44bf-a9db-551218af5132 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:26.602425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28833c-483c-44bf-a9db-551218af5132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:26.612900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28833c-483c-44bf-a9db-551218af5132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:26.614459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28833c-483c-44bf-a9db-551218af5132 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:26.625838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 949/1866] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:26.793801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:28.123666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea4ff-17f8-4d56-a9e9-9e41f78ace54 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:28.124632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea4ff-17f8-4d56-a9e9-9e41f78ace54 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:28.125055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea4ff-17f8-4d56-a9e9-9e41f78ace54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:28.154262 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-9ceea4ff-17f8-4d56-a9e9-9e41f78ace54 None None] MFA Rules not processed for user `8358ea0b1ec94a67a38eb88643dd1d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:28.155833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9ceea4ff-17f8-4d56-a9e9-9e41f78ace54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:28.274584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 918/1867] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:28.279108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28833c-483c-44bf-a9db-551218af5132 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:28.294078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28833c-483c-44bf-a9db-551218af5132 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:28.301059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87b58-9bc7-4234-a4e3-0ebf86135b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:28.301965 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87b58-9bc7-4234-a4e3-0ebf86135b77 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:28.302387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87b58-9bc7-4234-a4e3-0ebf86135b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:28.302874 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87b58-9bc7-4234-a4e3-0ebf86135b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:28.304170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87b58-9bc7-4234-a4e3-0ebf86135b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:28.305089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceea4ff-17f8-4d56-a9e9-9e41f78ace54 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:28.307339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9ceea4ff-17f8-4d56-a9e9-9e41f78ace54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:28.308062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87b58-9bc7-4234-a4e3-0ebf86135b77 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:28.337491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceea4ff-17f8-4d56-a9e9-9e41f78ace54 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:28.343241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:28.344234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:28.344525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:28.344857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] PATH_INFO: `/v3/users/646e1ee67568440994eb6e0e8a7833d3` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:28.346366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=646e1ee67568440994eb6e0e8a7833d3)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:28.348631 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:28.448693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 950/1868] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:28 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:28.450265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87b58-9bc7-4234-a4e3-0ebf86135b77 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:28.555788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87b58-9bc7-4234-a4e3-0ebf86135b77 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:28.566000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:28.579939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c820f-d49f-42c6-97b5-4ab4ae72bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:28.579939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c820f-d49f-42c6-97b5-4ab4ae72bfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:28.579939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c820f-d49f-42c6-97b5-4ab4ae72bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:28.579939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c820f-d49f-42c6-97b5-4ab4ae72bfd3 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:28.581267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c820f-d49f-42c6-97b5-4ab4ae72bfd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:28.581267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c820f-d49f-42c6-97b5-4ab4ae72bfd3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:28.622212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646e1ee67568440994eb6e0e8a7833d3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:28.635003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646e1ee67568440994eb6e0e8a7833d3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:28.635872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646e1ee67568440994eb6e0e8a7833d3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:28.666043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646e1ee67568440994eb6e0e8a7833d3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:28.666817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfab965-cf6e-449c-8fe2-d100ef2bf815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646e1ee67568440994eb6e0e8a7833d3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:28.742936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 951/1869] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:28 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:28.747713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c820f-d49f-42c6-97b5-4ab4ae72bfd3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:28.749010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f69c820f-d49f-42c6-97b5-4ab4ae72bfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:28.768818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c820f-d49f-42c6-97b5-4ab4ae72bfd3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:28.775879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbd7ba-09d6-4a1c-ac4d-5e18f13a7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:28.776831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbd7ba-09d6-4a1c-ac4d-5e18f13a7cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:28.777859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbd7ba-09d6-4a1c-ac4d-5e18f13a7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:28.778206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbd7ba-09d6-4a1c-ac4d-5e18f13a7cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:28.779040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbd7ba-09d6-4a1c-ac4d-5e18f13a7cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:28.781672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 919/1870] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:28 2022] DELETE /identity/v3/users/646e1ee67568440994eb6e0e8a7833d3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:28.787964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbd7ba-09d6-4a1c-ac4d-5e18f13a7cf1 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:28.798727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 952/1871] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:05:28.800835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c926-f864-4943-aba3-25a6dc89e417 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:28.802693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c926-f864-4943-aba3-25a6dc89e417 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:28.802915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbd7ba-09d6-4a1c-ac4d-5e18f13a7cf1 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:28.803037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c926-f864-4943-aba3-25a6dc89e417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:28.816640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbd7ba-09d6-4a1c-ac4d-5e18f13a7cf1 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:28.833630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-22d3c926-f864-4943-aba3-25a6dc89e417 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:28.834989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-22d3c926-f864-4943-aba3-25a6dc89e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:28.895306 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477bc36-48b4-4795-bce3-3fd5d17caae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:28.896568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477bc36-48b4-4795-bce3-3fd5d17caae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:28.897737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477bc36-48b4-4795-bce3-3fd5d17caae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:28.899046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477bc36-48b4-4795-bce3-3fd5d17caae2 admin admin] PATH_INFO: `/v3/projects/dcbdcb4c4a5f4037be64c1e6e4c13eca/users/415c23ce52ce466fa81bc74b143353e1/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:28.924949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477bc36-48b4-4795-bce3-3fd5d17caae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbdcb4c4a5f4037be64c1e6e4c13eca, user_id=415c23ce52ce466fa81bc74b143353e1, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:28.929018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477bc36-48b4-4795-bce3-3fd5d17caae2 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:28.939361 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 920/1872] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:28.954052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c926-f864-4943-aba3-25a6dc89e417 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:28.954052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-22d3c926-f864-4943-aba3-25a6dc89e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:29.008785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 953/1873] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:28 2022] PUT /identity/v3/projects/dcbdcb4c4a5f4037be64c1e6e4c13eca/users/415c23ce52ce466fa81bc74b143353e1/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:29.012583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477bc36-48b4-4795-bce3-3fd5d17caae2 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:29.040016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c926-f864-4943-aba3-25a6dc89e417 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:29.109195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477bc36-48b4-4795-bce3-3fd5d17caae2 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:29.112359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f6c13-f433-473d-befc-4ac9c2eb63cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:29.113224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f6c13-f433-473d-befc-4ac9c2eb63cf service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:29.113519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f6c13-f433-473d-befc-4ac9c2eb63cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:29.113816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f6c13-f433-473d-befc-4ac9c2eb63cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:29.119858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59625e-2c34-47f8-8011-a7da67cf0953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:29.121282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59625e-2c34-47f8-8011-a7da67cf0953 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:29.121638 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59625e-2c34-47f8-8011-a7da67cf0953 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:29.122831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59625e-2c34-47f8-8011-a7da67cf0953 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:29.123932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59625e-2c34-47f8-8011-a7da67cf0953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:29.125095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f6c13-f433-473d-befc-4ac9c2eb63cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:29.128955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59625e-2c34-47f8-8011-a7da67cf0953 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:29.129093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f6c13-f433-473d-befc-4ac9c2eb63cf service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:29.138552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 921/1874] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:29.144470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 954/1875] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:05:29.148974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f6c13-f433-473d-befc-4ac9c2eb63cf service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:29.168963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f6c13-f433-473d-befc-4ac9c2eb63cf service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:29.168963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13ddba-f362-4d98-a0e0-94b3e039faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:29.168963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13ddba-f362-4d98-a0e0-94b3e039faf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:29.168963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13ddba-f362-4d98-a0e0-94b3e039faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:29.169363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13ddba-f362-4d98-a0e0-94b3e039faf1 admin admin] PATH_INFO: `/v3/projects/dcbdcb4c4a5f4037be64c1e6e4c13eca/users/415c23ce52ce466fa81bc74b143353e1/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:29.171353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13ddba-f362-4d98-a0e0-94b3e039faf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbdcb4c4a5f4037be64c1e6e4c13eca, user_id=415c23ce52ce466fa81bc74b143353e1, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:29.175147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13ddba-f362-4d98-a0e0-94b3e039faf1 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:29.202729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 922/1876] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:29 2022] PUT /identity/v3/projects/dcbdcb4c4a5f4037be64c1e6e4c13eca/users/415c23ce52ce466fa81bc74b143353e1/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:29.576568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:29.857558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59625e-2c34-47f8-8011-a7da67cf0953 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:29.860370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8b59625e-2c34-47f8-8011-a7da67cf0953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:29.889575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59625e-2c34-47f8-8011-a7da67cf0953 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:29.995692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:29.996584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:29.996872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:29.997153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] PATH_INFO: `/v3/projects/00cdd873e7be4800a1134bd9ec51bef1` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:29.998415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cdd873e7be4800a1134bd9ec51bef1)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:30.000719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:30.206989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cdd873e7be4800a1134bd9ec51bef1', 'request_id': 'req-6c2c03c3-7d07-4939-955a-85247462047d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.220707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cdd873e7be4800a1134bd9ec51bef1', 'request_id': 'req-6c2c03c3-7d07-4939-955a-85247462047d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.232275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cdd873e7be4800a1134bd9ec51bef1', 'request_id': 'req-6c2c03c3-7d07-4939-955a-85247462047d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.355169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] The token cache is being invalidate because project 00cdd873e7be4800a1134bd9ec51bef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:30.357716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.358915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6c2c03c3-7d07-4939-955a-85247462047d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.368654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13ddba-f362-4d98-a0e0-94b3e039faf1 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:30.369210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 955/1877] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:29 2022] DELETE /identity/v3/projects/00cdd873e7be4800a1134bd9ec51bef1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:30.370523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ee13ddba-f362-4d98-a0e0-94b3e039faf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:30.384179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13ddba-f362-4d98-a0e0-94b3e039faf1 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:30.474163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:30.475053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:30.475482 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:30.475819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] PATH_INFO: `/v3/users/639563f1d9fd438c8b9591b842c08a69` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:30.478316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=639563f1d9fd438c8b9591b842c08a69)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:30.479765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:30.780801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639563f1d9fd438c8b9591b842c08a69'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.801956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639563f1d9fd438c8b9591b842c08a69'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.809609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639563f1d9fd438c8b9591b842c08a69'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.826415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639563f1d9fd438c8b9591b842c08a69'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.827234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a643f5b0-934b-4fe7-b3b7-2229b70f6da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639563f1d9fd438c8b9591b842c08a69'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:30.832636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:30.926120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 923/1878] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:30 2022] DELETE /identity/v3/users/639563f1d9fd438c8b9591b842c08a69 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:30.998324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:31.620058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801f59-ef25-4cf0-993e-f2c8800c1daf None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:31.620569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801f59-ef25-4cf0-993e-f2c8800c1daf None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:31.620947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801f59-ef25-4cf0-993e-f2c8800c1daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:31.658472 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-79801f59-ef25-4cf0-993e-f2c8800c1daf None None] MFA Rules not processed for user `415c23ce52ce466fa81bc74b143353e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:31.659867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-79801f59-ef25-4cf0-993e-f2c8800c1daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:31.747262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 956/1879] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:31.758529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c0cfa-61ad-495f-8cc7-289ec526dcd1 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:31.759046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c0cfa-61ad-495f-8cc7-289ec526dcd1 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:31.759138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c0cfa-61ad-495f-8cc7-289ec526dcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:31.776563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3f5c0cfa-61ad-495f-8cc7-289ec526dcd1 None None] MFA Rules not processed for user `8358ea0b1ec94a67a38eb88643dd1d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:31.777751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3f5c0cfa-61ad-495f-8cc7-289ec526dcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:31.804828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79801f59-ef25-4cf0-993e-f2c8800c1daf None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:31.807526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-79801f59-ef25-4cf0-993e-f2c8800c1daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:31.852208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 924/1880] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:31.864026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c0cfa-61ad-495f-8cc7-289ec526dcd1 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:31.866747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3f5c0cfa-61ad-495f-8cc7-289ec526dcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:31.911742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79801f59-ef25-4cf0-993e-f2c8800c1daf None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:31.917143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:31.920602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:31.920602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:31.920602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] PATH_INFO: `/v3/projects/7692c194ffbc4527859ef345de58e62d` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:31.920602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7692c194ffbc4527859ef345de58e62d)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:31.921712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:31.958380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c0cfa-61ad-495f-8cc7-289ec526dcd1 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:31.964133 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8a47c-3610-4350-be51-7fff1ec3006d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:31.964883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8a47c-3610-4350-be51-7fff1ec3006d service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:31.965169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8a47c-3610-4350-be51-7fff1ec3006d service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:31.965445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8a47c-3610-4350-be51-7fff1ec3006d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:31.967665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-faa8a47c-3610-4350-be51-7fff1ec3006d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:31.979474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8a47c-3610-4350-be51-7fff1ec3006d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:31.982129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8a47c-3610-4350-be51-7fff1ec3006d service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:31.994734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 925/1881] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:32.037101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7692c194ffbc4527859ef345de58e62d', 'request_id': 'req-ef16db29-0568-4c6c-acb7-1d587db3b8d6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:32.044215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7692c194ffbc4527859ef345de58e62d', 'request_id': 'req-ef16db29-0568-4c6c-acb7-1d587db3b8d6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:32.051692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7692c194ffbc4527859ef345de58e62d', 'request_id': 'req-ef16db29-0568-4c6c-acb7-1d587db3b8d6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:32.198218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] The token cache is being invalidate because project 7692c194ffbc4527859ef345de58e62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:32.198521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:32.201121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ef16db29-0568-4c6c-acb7-1d587db3b8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:32.207786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 957/1882] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:31 2022] DELETE /identity/v3/projects/7692c194ffbc4527859ef345de58e62d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:32.212036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbe24-e6ce-44c4-87a8-fd2991158967 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:32.212441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbe24-e6ce-44c4-87a8-fd2991158967 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:32.212890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbe24-e6ce-44c4-87a8-fd2991158967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:32.248650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c49bbe24-e6ce-44c4-87a8-fd2991158967 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:32.251641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c49bbe24-e6ce-44c4-87a8-fd2991158967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:32.359673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 926/1883] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:32.361425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108b316-c103-4d7c-89d0-ac52af6d85bf None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:32.361724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108b316-c103-4d7c-89d0-ac52af6d85bf None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:32.362005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108b316-c103-4d7c-89d0-ac52af6d85bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:32.382124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4108b316-c103-4d7c-89d0-ac52af6d85bf None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:32.383528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4108b316-c103-4d7c-89d0-ac52af6d85bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:32.392889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 958/1884] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:32.396719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bbe24-e6ce-44c4-87a8-fd2991158967 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:32.408283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bbe24-e6ce-44c4-87a8-fd2991158967 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:32.414568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e2293-7906-4eda-a899-43c9fdfc5913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:32.415245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2293-7906-4eda-a899-43c9fdfc5913 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:32.415526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2293-7906-4eda-a899-43c9fdfc5913 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:32.415829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2293-7906-4eda-a899-43c9fdfc5913 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:32.416557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e2293-7906-4eda-a899-43c9fdfc5913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:32.416864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e2293-7906-4eda-a899-43c9fdfc5913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:32.418512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e2293-7906-4eda-a899-43c9fdfc5913 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:32.434640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 927/1885] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:05:32.435821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108b316-c103-4d7c-89d0-ac52af6d85bf None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:32.445228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108b316-c103-4d7c-89d0-ac52af6d85bf None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:32.450137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283f359-156d-481b-96e3-d93361de7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:32.450803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283f359-156d-481b-96e3-d93361de7d2b admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:32.451256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283f359-156d-481b-96e3-d93361de7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:32.451381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283f359-156d-481b-96e3-d93361de7d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:32.452122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283f359-156d-481b-96e3-d93361de7d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:32.456667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283f359-156d-481b-96e3-d93361de7d2b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:32.610434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:32.615427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 959/1886] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:32 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:32.616513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e2293-7906-4eda-a899-43c9fdfc5913 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:32.645048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e2293-7906-4eda-a899-43c9fdfc5913 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:32.733118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e11f-17fc-42b7-8387-00be15a17ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:32.734060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e11f-17fc-42b7-8387-00be15a17ead admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:32.734863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e11f-17fc-42b7-8387-00be15a17ead admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:32.734863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e11f-17fc-42b7-8387-00be15a17ead admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:32.735527 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e11f-17fc-42b7-8387-00be15a17ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:32.738257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e11f-17fc-42b7-8387-00be15a17ead admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:32.873104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:32.878568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 928/1887] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:32 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:32.883947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283f359-156d-481b-96e3-d93361de7d2b admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:32.895866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283f359-156d-481b-96e3-d93361de7d2b admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:32.904908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb949398-f47c-455a-86d3-50bc89a5ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:32.905627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb949398-f47c-455a-86d3-50bc89a5ef1c admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:32.905940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb949398-f47c-455a-86d3-50bc89a5ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:32.906221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb949398-f47c-455a-86d3-50bc89a5ef1c admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:32.907047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb949398-f47c-455a-86d3-50bc89a5ef1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:32.909136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb949398-f47c-455a-86d3-50bc89a5ef1c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:32.921336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 960/1888] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:32.925573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e11f-17fc-42b7-8387-00be15a17ead admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:32.937442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e11f-17fc-42b7-8387-00be15a17ead admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:32.942693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc68d9-7f7c-4942-be93-d71e7054559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:32.943361 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc68d9-7f7c-4942-be93-d71e7054559a admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:32.943805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc68d9-7f7c-4942-be93-d71e7054559a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:32.944088 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc68d9-7f7c-4942-be93-d71e7054559a admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:32.944875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc68d9-7f7c-4942-be93-d71e7054559a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:32.946495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc68d9-7f7c-4942-be93-d71e7054559a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:32.959774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 929/1889] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:32.962856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb949398-f47c-455a-86d3-50bc89a5ef1c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:32.973714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb949398-f47c-455a-86d3-50bc89a5ef1c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:32.978794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db3784-ffd2-45d7-a919-dbaf8cb09695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:32.980144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3784-ffd2-45d7-a919-dbaf8cb09695 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:32.980613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3784-ffd2-45d7-a919-dbaf8cb09695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:32.981007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3784-ffd2-45d7-a919-dbaf8cb09695 admin admin] PATH_INFO: `/v3/projects/be8129febbc641b397065be444169ae4/users/ebd793031de64fd18b8eb7e297dd6b8d/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:32.998260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db3784-ffd2-45d7-a919-dbaf8cb09695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8129febbc641b397065be444169ae4, user_id=ebd793031de64fd18b8eb7e297dd6b8d, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:33.001019 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db3784-ffd2-45d7-a919-dbaf8cb09695 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:33.216584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 961/1890] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:32 2022] PUT /identity/v3/projects/be8129febbc641b397065be444169ae4/users/ebd793031de64fd18b8eb7e297dd6b8d/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:33.237739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b16560-a1f4-4344-8e11-34075ed516f9 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:33.237739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b16560-a1f4-4344-8e11-34075ed516f9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:33.237739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b16560-a1f4-4344-8e11-34075ed516f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:33.264611 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-95b16560-a1f4-4344-8e11-34075ed516f9 None None] MFA Rules not processed for user `ebd793031de64fd18b8eb7e297dd6b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:33.470787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-95b16560-a1f4-4344-8e11-34075ed516f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:33.470787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 930/1891] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:33.472913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db3784-ffd2-45d7-a919-dbaf8cb09695 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:33.550855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db3784-ffd2-45d7-a919-dbaf8cb09695 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:33.550855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f71a9-7bab-41be-9da3-81209dba5f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:33.550855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f71a9-7bab-41be-9da3-81209dba5f87 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:33.550855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f71a9-7bab-41be-9da3-81209dba5f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:33.551221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f71a9-7bab-41be-9da3-81209dba5f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:33.551221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f71a9-7bab-41be-9da3-81209dba5f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:33.551221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f71a9-7bab-41be-9da3-81209dba5f87 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:33.747192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 962/1892] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:33 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:33.751289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b16560-a1f4-4344-8e11-34075ed516f9 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:33.763906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b16560-a1f4-4344-8e11-34075ed516f9 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:33.827945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291354-d3b5-4a0a-a4b1-d7f26fc0ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:33.828629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291354-d3b5-4a0a-a4b1-d7f26fc0ee60 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:33.828916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291354-d3b5-4a0a-a4b1-d7f26fc0ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:33.829198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291354-d3b5-4a0a-a4b1-d7f26fc0ee60 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:33.829898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291354-d3b5-4a0a-a4b1-d7f26fc0ee60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:33.832398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291354-d3b5-4a0a-a4b1-d7f26fc0ee60 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:33.995484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 931/1893] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:33 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:34.002227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f71a9-7bab-41be-9da3-81209dba5f87 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:34.012549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f71a9-7bab-41be-9da3-81209dba5f87 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:34.018264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077a5f-d325-40a6-8dba-893e8676efef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:34.019195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077a5f-d325-40a6-8dba-893e8676efef admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:34.019878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077a5f-d325-40a6-8dba-893e8676efef admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:34.020310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077a5f-d325-40a6-8dba-893e8676efef admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:34.021990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55077a5f-d325-40a6-8dba-893e8676efef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:34.023957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55077a5f-d325-40a6-8dba-893e8676efef admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:34.042001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 963/1894] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:34.046152 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291354-d3b5-4a0a-a4b1-d7f26fc0ee60 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:34.058224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291354-d3b5-4a0a-a4b1-d7f26fc0ee60 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:34.064035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3620028-ceaa-4d87-acf6-e1c5960d5476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:34.065001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3620028-ceaa-4d87-acf6-e1c5960d5476 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:34.065492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3620028-ceaa-4d87-acf6-e1c5960d5476 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:34.065839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3620028-ceaa-4d87-acf6-e1c5960d5476 admin admin] PATH_INFO: `/v3/projects/9da0e8fb743b4637a1897c9911368a4e/users/a93994cc83d4406abf9c18af5e7f5a61/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:34.084024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3620028-ceaa-4d87-acf6-e1c5960d5476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da0e8fb743b4637a1897c9911368a4e, user_id=a93994cc83d4406abf9c18af5e7f5a61, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:34.087640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3620028-ceaa-4d87-acf6-e1c5960d5476 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:34.211854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 932/1895] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:34 2022] PUT /identity/v3/projects/9da0e8fb743b4637a1897c9911368a4e/users/a93994cc83d4406abf9c18af5e7f5a61/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:34.215752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077a5f-d325-40a6-8dba-893e8676efef admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:34.227127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077a5f-d325-40a6-8dba-893e8676efef admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:34.304158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027ed51-2d93-497b-83a0-c00de1d4ef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:34.307630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ed51-2d93-497b-83a0-c00de1d4ef29 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:34.307630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ed51-2d93-497b-83a0-c00de1d4ef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:34.307630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ed51-2d93-497b-83a0-c00de1d4ef29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:34.307630 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027ed51-2d93-497b-83a0-c00de1d4ef29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:34.308005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027ed51-2d93-497b-83a0-c00de1d4ef29 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:34.319648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 964/1896] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:34.324193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3620028-ceaa-4d87-acf6-e1c5960d5476 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:34.334567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3620028-ceaa-4d87-acf6-e1c5960d5476 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:34.340211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9584d5d-d320-4e2a-ba8c-a3981ec97a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:34.341099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9584d5d-d320-4e2a-ba8c-a3981ec97a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:34.341636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9584d5d-d320-4e2a-ba8c-a3981ec97a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:34.341932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9584d5d-d320-4e2a-ba8c-a3981ec97a74 admin admin] PATH_INFO: `/v3/projects/9da0e8fb743b4637a1897c9911368a4e/users/a93994cc83d4406abf9c18af5e7f5a61/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:34.343927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9584d5d-d320-4e2a-ba8c-a3981ec97a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da0e8fb743b4637a1897c9911368a4e, user_id=a93994cc83d4406abf9c18af5e7f5a61, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:34.346574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9584d5d-d320-4e2a-ba8c-a3981ec97a74 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:34.359748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 933/1897] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:34 2022] PUT /identity/v3/projects/9da0e8fb743b4637a1897c9911368a4e/users/a93994cc83d4406abf9c18af5e7f5a61/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:34.370377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b279-a0da-412e-bb37-632b81058c43 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:34.371239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b279-a0da-412e-bb37-632b81058c43 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:34.371239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b279-a0da-412e-bb37-632b81058c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:34.400685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-7857b279-a0da-412e-bb37-632b81058c43 None None] MFA Rules not processed for user `a93994cc83d4406abf9c18af5e7f5a61`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:34.402265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7857b279-a0da-412e-bb37-632b81058c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:34.483066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 965/1898] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:34.498984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9584d5d-d320-4e2a-ba8c-a3981ec97a74 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:34.498984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b9584d5d-d320-4e2a-ba8c-a3981ec97a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:34.577841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9584d5d-d320-4e2a-ba8c-a3981ec97a74 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:34.581582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185447f8-b1a2-4d8c-8f10-946967ef1e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:34.582244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185447f8-b1a2-4d8c-8f10-946967ef1e28 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:34.582510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185447f8-b1a2-4d8c-8f10-946967ef1e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:34.582787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185447f8-b1a2-4d8c-8f10-946967ef1e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:34.648757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185447f8-b1a2-4d8c-8f10-946967ef1e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:34.650408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185447f8-b1a2-4d8c-8f10-946967ef1e28 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:34.660489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 934/1899] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:34.742715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:34.919357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:37.044574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857b279-a0da-412e-bb37-632b81058c43 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:37.046683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7857b279-a0da-412e-bb37-632b81058c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:37.119071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857b279-a0da-412e-bb37-632b81058c43 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:37.123983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:37.124944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:37.125224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:37.125541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] PATH_INFO: `/v3/users/339acd051fc64517a35389f6de5d71f0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:37.126758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=339acd051fc64517a35389f6de5d71f0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:37.128765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:37.410311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339acd051fc64517a35389f6de5d71f0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:37.489120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339acd051fc64517a35389f6de5d71f0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:37.497443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339acd051fc64517a35389f6de5d71f0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:37.509845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339acd051fc64517a35389f6de5d71f0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:37.510569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339acd051fc64517a35389f6de5d71f0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:37.517198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 966/1900] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:37 2022] DELETE /identity/v3/users/339acd051fc64517a35389f6de5d71f0 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:37.521805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd469cb-6bc5-47c0-8286-47e190b6c085 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:37.526312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd469cb-6bc5-47c0-8286-47e190b6c085 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:37.526312 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd469cb-6bc5-47c0-8286-47e190b6c085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:37.541040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-7fd469cb-6bc5-47c0-8286-47e190b6c085 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:37.542242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7fd469cb-6bc5-47c0-8286-47e190b6c085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:37.609240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 935/1901] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:37.619345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:37.621121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:37.685700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21710999-e4a3-41f5-b3a1-2518d66d77fa admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:37.689910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087d1a-1469-41c0-afa8-b15a00a7d5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:37.690575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087d1a-1469-41c0-afa8-b15a00a7d5ec service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:37.690860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087d1a-1469-41c0-afa8-b15a00a7d5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:37.691150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087d1a-1469-41c0-afa8-b15a00a7d5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:37.701589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087d1a-1469-41c0-afa8-b15a00a7d5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:37.703129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087d1a-1469-41c0-afa8-b15a00a7d5ec service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:37.719748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 967/1902] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:38.456806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd469cb-6bc5-47c0-8286-47e190b6c085 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:38.458346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7fd469cb-6bc5-47c0-8286-47e190b6c085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:38.480343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd469cb-6bc5-47c0-8286-47e190b6c085 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:38.485609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:38.486476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:38.486762 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:38.487371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] PATH_INFO: `/v3/projects/e8f6e45743cd42c8a5b96a054dfddfb9` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:38.488511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f6e45743cd42c8a5b96a054dfddfb9)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:38.490993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:38.727971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f6e45743cd42c8a5b96a054dfddfb9', 'request_id': 'req-66e79abe-686f-497f-9db7-da31d20df232'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:38.741127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f6e45743cd42c8a5b96a054dfddfb9', 'request_id': 'req-66e79abe-686f-497f-9db7-da31d20df232'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:38.759011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f6e45743cd42c8a5b96a054dfddfb9', 'request_id': 'req-66e79abe-686f-497f-9db7-da31d20df232'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:38.767290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:38.852336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] The token cache is being invalidate because project e8f6e45743cd42c8a5b96a054dfddfb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:38.852782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:38.854057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-66e79abe-686f-497f-9db7-da31d20df232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:38.863457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 936/1903] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:38 2022] DELETE /identity/v3/projects/e8f6e45743cd42c8a5b96a054dfddfb9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:38.865308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087d1a-1469-41c0-afa8-b15a00a7d5ec service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:38.880842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087d1a-1469-41c0-afa8-b15a00a7d5ec service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:38.945802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:38.946676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:38.947027 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:38.947373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] PATH_INFO: `/v3/users/3d3a7fea5c174ac09dc8055190633df0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:38.948946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3a7fea5c174ac09dc8055190633df0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:38.951369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:38.986885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:39.206626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3a7fea5c174ac09dc8055190633df0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:39.301173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3a7fea5c174ac09dc8055190633df0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:39.314046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3a7fea5c174ac09dc8055190633df0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:39.321387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0e774-46ed-4d3b-8632-e266c3fc85f6 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:39.321677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0e774-46ed-4d3b-8632-e266c3fc85f6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:39.321959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0e774-46ed-4d3b-8632-e266c3fc85f6 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:39.323397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 937/1904] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 17:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:05:39.327935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3a7fea5c174ac09dc8055190633df0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:39.334959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3a7fea5c174ac09dc8055190633df0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:39.338208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 968/1905] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:38 2022] DELETE /identity/v3/users/3d3a7fea5c174ac09dc8055190633df0 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:39.344666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684bfb8-cde0-4050-999e-010ad35fee5b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:39.345298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684bfb8-cde0-4050-999e-010ad35fee5b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:39.345991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684bfb8-cde0-4050-999e-010ad35fee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:39.384877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0684bfb8-cde0-4050-999e-010ad35fee5b None None] MFA Rules not processed for user `bae184afff284dcaa228859902e92191`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:39.388120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0684bfb8-cde0-4050-999e-010ad35fee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:39.486408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 938/1906] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 17:05:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:39.502879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:39.504424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:39.523169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5530e3d-03f8-4fcd-b7df-ce15202e6f0e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:39.532815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684bfb8-cde0-4050-999e-010ad35fee5b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:39.535923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0684bfb8-cde0-4050-999e-010ad35fee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:39.539370 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9374c-828f-4a3e-857a-8f87e53827dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:39.540668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9374c-828f-4a3e-857a-8f87e53827dd service placement] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:39.541145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9374c-828f-4a3e-857a-8f87e53827dd service placement] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:39.541363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9374c-828f-4a3e-857a-8f87e53827dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:39.575089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9374c-828f-4a3e-857a-8f87e53827dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:39.579621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9374c-828f-4a3e-857a-8f87e53827dd service placement] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:39.635720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 969/1907] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:39.654303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684bfb8-cde0-4050-999e-010ad35fee5b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:39.656523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:39.657570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:39.657929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:39.658279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] PATH_INFO: `/v3/users/0a925b17f9b14d149d660cb50f4a4197` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:39.659902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a925b17f9b14d149d660cb50f4a4197)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:39.661998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:39.943170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9374c-828f-4a3e-857a-8f87e53827dd service placement] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:39.944903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c0f9374c-828f-4a3e-857a-8f87e53827dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:39.962384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9374c-828f-4a3e-857a-8f87e53827dd service placement] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:39.968184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:39.969616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:39.970096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:39.970555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] PATH_INFO: `/v3/projects/c78270aaab6d4391abc95b5d1ecba3f2` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:39.973971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78270aaab6d4391abc95b5d1ecba3f2)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:39.977537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:40.046335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a925b17f9b14d149d660cb50f4a4197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.062362 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a925b17f9b14d149d660cb50f4a4197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.063786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a925b17f9b14d149d660cb50f4a4197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.086851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a925b17f9b14d149d660cb50f4a4197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.087818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-783531c3-da80-4bcc-b046-a2e23c8714f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a925b17f9b14d149d660cb50f4a4197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.181131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78270aaab6d4391abc95b5d1ecba3f2', 'request_id': 'req-addf449b-76ad-4992-b88d-d091c33c077c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.191021 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78270aaab6d4391abc95b5d1ecba3f2', 'request_id': 'req-addf449b-76ad-4992-b88d-d091c33c077c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.197267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78270aaab6d4391abc95b5d1ecba3f2', 'request_id': 'req-addf449b-76ad-4992-b88d-d091c33c077c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.273671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 939/1908] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:39 2022] DELETE /identity/v3/users/0a925b17f9b14d149d660cb50f4a4197 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:40.398713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] The token cache is being invalidate because project c78270aaab6d4391abc95b5d1ecba3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:40.399010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.399723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-addf449b-76ad-4992-b88d-d091c33c077c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.401312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 970/1909] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:39 2022] DELETE /identity/v3/projects/c78270aaab6d4391abc95b5d1ecba3f2 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:40.412964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140dc1-a17f-4e77-b81a-745f4820a38a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.413295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140dc1-a17f-4e77-b81a-745f4820a38a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.413638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140dc1-a17f-4e77-b81a-745f4820a38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.441188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8e140dc1-a17f-4e77-b81a-745f4820a38a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:40.441188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8e140dc1-a17f-4e77-b81a-745f4820a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:40.514504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 940/1910] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:40.523325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb147e8-621a-4cd7-84d5-9adad7d91c28 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.523643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb147e8-621a-4cd7-84d5-9adad7d91c28 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.523983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb147e8-621a-4cd7-84d5-9adad7d91c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.542885 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-feb147e8-621a-4cd7-84d5-9adad7d91c28 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:40.544423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-feb147e8-621a-4cd7-84d5-9adad7d91c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:40.545055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140dc1-a17f-4e77-b81a-745f4820a38a None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:40.546653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8e140dc1-a17f-4e77-b81a-745f4820a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:40.553289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 971/1911] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:40.558976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb147e8-621a-4cd7-84d5-9adad7d91c28 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:40.565532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140dc1-a17f-4e77-b81a-745f4820a38a None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:40.577869 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb147e8-621a-4cd7-84d5-9adad7d91c28 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:40.578788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827038b0-2aff-453e-b7ba-460da2083fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:40.579376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:40.579760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827038b0-2aff-453e-b7ba-460da2083fff admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.580050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827038b0-2aff-453e-b7ba-460da2083fff admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.580331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827038b0-2aff-453e-b7ba-460da2083fff admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.581072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827038b0-2aff-453e-b7ba-460da2083fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:40.581431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827038b0-2aff-453e-b7ba-460da2083fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:40.582896 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.583061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827038b0-2aff-453e-b7ba-460da2083fff admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:40.583426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.583819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] PATH_INFO: `/v3/projects/eb43a0786f3a4716adfb902287fdeb13` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.585383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb43a0786f3a4716adfb902287fdeb13)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:40.588076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:40.601461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 972/1912] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:05:40.602648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827038b0-2aff-453e-b7ba-460da2083fff admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:40.613137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827038b0-2aff-453e-b7ba-460da2083fff admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:40.618614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cedab-dfaa-47f5-b3ef-9b329fc7fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:40.619267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cedab-dfaa-47f5-b3ef-9b329fc7fa67 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.619730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cedab-dfaa-47f5-b3ef-9b329fc7fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.620027 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cedab-dfaa-47f5-b3ef-9b329fc7fa67 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.620718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cedab-dfaa-47f5-b3ef-9b329fc7fa67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:40.622645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cedab-dfaa-47f5-b3ef-9b329fc7fa67 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:40.733544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb43a0786f3a4716adfb902287fdeb13', 'request_id': 'req-3e8241e5-a647-46ce-9520-927117959daf'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.734403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 973/1913] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:40 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:40.738496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cedab-dfaa-47f5-b3ef-9b329fc7fa67 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:40.743853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb43a0786f3a4716adfb902287fdeb13', 'request_id': 'req-3e8241e5-a647-46ce-9520-927117959daf'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.750667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb43a0786f3a4716adfb902287fdeb13', 'request_id': 'req-3e8241e5-a647-46ce-9520-927117959daf'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.806575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cedab-dfaa-47f5-b3ef-9b329fc7fa67 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:40.811236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d30e7-1872-4b2a-8ef3-b455c8d8a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:40.811941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d30e7-1872-4b2a-8ef3-b455c8d8a6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.812219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d30e7-1872-4b2a-8ef3-b455c8d8a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.812493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d30e7-1872-4b2a-8ef3-b455c8d8a6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.813185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d30e7-1872-4b2a-8ef3-b455c8d8a6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:40.815097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d30e7-1872-4b2a-8ef3-b455c8d8a6c7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:40.840448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] The token cache is being invalidate because project eb43a0786f3a4716adfb902287fdeb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:40.840739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.841874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3e8241e5-a647-46ce-9520-927117959daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:40.844424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 941/1914] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:40 2022] DELETE /identity/v3/projects/eb43a0786f3a4716adfb902287fdeb13 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:40.852835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d35ec-b135-4629-8c7e-a52ca2b5a159 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.853640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d35ec-b135-4629-8c7e-a52ca2b5a159 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.854143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d35ec-b135-4629-8c7e-a52ca2b5a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.877391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1a9d35ec-b135-4629-8c7e-a52ca2b5a159 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:40.878605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1a9d35ec-b135-4629-8c7e-a52ca2b5a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:40.902339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 942/1915] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:40.910360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8700459-d715-428e-81d3-6237e3132df5 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.910773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8700459-d715-428e-81d3-6237e3132df5 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.911140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8700459-d715-428e-81d3-6237e3132df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.934934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a8700459-d715-428e-81d3-6237e3132df5 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:40.941587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a8700459-d715-428e-81d3-6237e3132df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:40.943812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 974/1916] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:40 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:40.947415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d30e7-1872-4b2a-8ef3-b455c8d8a6c7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:40.949379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d65d30e7-1872-4b2a-8ef3-b455c8d8a6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:40.964153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 943/1917] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:40.965125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8700459-d715-428e-81d3-6237e3132df5 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:40.965249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d30e7-1872-4b2a-8ef3-b455c8d8a6c7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:40.978125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8700459-d715-428e-81d3-6237e3132df5 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:40.983448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b388c-fb23-4fd8-b53b-797736e8fc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:40.984166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b388c-fb23-4fd8-b53b-797736e8fc2d admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.984659 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b388c-fb23-4fd8-b53b-797736e8fc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.985232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b388c-fb23-4fd8-b53b-797736e8fc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.985350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa582847-966d-48bd-a865-18330a92dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:40.986458 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b388c-fb23-4fd8-b53b-797736e8fc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:40.988340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa582847-966d-48bd-a865-18330a92dc12 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:40.988651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa582847-966d-48bd-a865-18330a92dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:40.988936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa582847-966d-48bd-a865-18330a92dc12 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:40.989710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa582847-966d-48bd-a865-18330a92dc12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:40.990020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa582847-966d-48bd-a865-18330a92dc12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:40.992015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa582847-966d-48bd-a865-18330a92dc12 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.008727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 944/1918] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:05:41.010673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b388c-fb23-4fd8-b53b-797736e8fc2d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.013400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa582847-966d-48bd-a865-18330a92dc12 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.026571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa582847-966d-48bd-a865-18330a92dc12 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.029044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 975/1919] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:41.030166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b388c-fb23-4fd8-b53b-797736e8fc2d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.032340 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e5856-7110-4cad-8f60-897e16d09037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.033091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e5856-7110-4cad-8f60-897e16d09037 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.033447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e5856-7110-4cad-8f60-897e16d09037 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.034061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e5856-7110-4cad-8f60-897e16d09037 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.035889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e5856-7110-4cad-8f60-897e16d09037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.037865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e5856-7110-4cad-8f60-897e16d09037 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.041441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b388c-fb23-4fd8-b53b-797736e8fc2d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.047055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8cf6-d678-42cf-b476-937bf99ca6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.048008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8cf6-d678-42cf-b476-937bf99ca6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.048604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8cf6-d678-42cf-b476-937bf99ca6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.049059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8cf6-d678-42cf-b476-937bf99ca6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.050558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d8cf6-d678-42cf-b476-937bf99ca6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.052450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d8cf6-d678-42cf-b476-937bf99ca6a3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.070229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 976/1920] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:41.076569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8cf6-d678-42cf-b476-937bf99ca6a3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.090832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8cf6-d678-42cf-b476-937bf99ca6a3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.097722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb63eae-af14-4521-8fc7-f07a0a298bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.098628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb63eae-af14-4521-8fc7-f07a0a298bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.098909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb63eae-af14-4521-8fc7-f07a0a298bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.099183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb63eae-af14-4521-8fc7-f07a0a298bc9 admin admin] PATH_INFO: `/v3/projects/b00e76619450451a93d4da8d07d3918b/users/af6abea1d2bc4df19c7b64d388996b7e/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.115293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb63eae-af14-4521-8fc7-f07a0a298bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00e76619450451a93d4da8d07d3918b, user_id=af6abea1d2bc4df19c7b64d388996b7e, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.118103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb63eae-af14-4521-8fc7-f07a0a298bc9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.171913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 945/1921] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:41 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:41.176045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e5856-7110-4cad-8f60-897e16d09037 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.210753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 977/1922] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:41 2022] PUT /identity/v3/projects/b00e76619450451a93d4da8d07d3918b/users/af6abea1d2bc4df19c7b64d388996b7e/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:41.228376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddeeda-8249-48bb-b4ca-0f845849e907 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.229368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddeeda-8249-48bb-b4ca-0f845849e907 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.229783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddeeda-8249-48bb-b4ca-0f845849e907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.282721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e5856-7110-4cad-8f60-897e16d09037 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.289123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-59ddeeda-8249-48bb-b4ca-0f845849e907 None None] MFA Rules not processed for user `af6abea1d2bc4df19c7b64d388996b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:41.293632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-59ddeeda-8249-48bb-b4ca-0f845849e907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:41.358351 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519b409-5338-4432-afed-69ee5190303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.359039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519b409-5338-4432-afed-69ee5190303d admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.359320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519b409-5338-4432-afed-69ee5190303d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.359653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519b409-5338-4432-afed-69ee5190303d admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.360330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519b409-5338-4432-afed-69ee5190303d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.362334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519b409-5338-4432-afed-69ee5190303d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.385154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 978/1923] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:41.389838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddeeda-8249-48bb-b4ca-0f845849e907 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.401676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddeeda-8249-48bb-b4ca-0f845849e907 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.406693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d4a1a-b2e8-425e-a284-c75b5e5284d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.407377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d4a1a-b2e8-425e-a284-c75b5e5284d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.407689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d4a1a-b2e8-425e-a284-c75b5e5284d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.407968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d4a1a-b2e8-425e-a284-c75b5e5284d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.408755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d4a1a-b2e8-425e-a284-c75b5e5284d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.410786 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d4a1a-b2e8-425e-a284-c75b5e5284d8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.571588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 946/1924] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:41 2022] POST /identity/v3/users => generated 294 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:41.579483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519b409-5338-4432-afed-69ee5190303d admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.611381 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519b409-5338-4432-afed-69ee5190303d admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.611598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 979/1925] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:41 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:41.611955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d4a1a-b2e8-425e-a284-c75b5e5284d8 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.754124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d4a1a-b2e8-425e-a284-c75b5e5284d8 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.754124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e35e0d-35af-4abe-803f-4ef9828375e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.754124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e35e0d-35af-4abe-803f-4ef9828375e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.754124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e35e0d-35af-4abe-803f-4ef9828375e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.754572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e35e0d-35af-4abe-803f-4ef9828375e3 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.754572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e35e0d-35af-4abe-803f-4ef9828375e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.754572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e35e0d-35af-4abe-803f-4ef9828375e3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.765583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f88f6-449b-46ab-8ca4-b5afd509092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.766646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f88f6-449b-46ab-8ca4-b5afd509092b admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.767291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f88f6-449b-46ab-8ca4-b5afd509092b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.767639 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f88f6-449b-46ab-8ca4-b5afd509092b admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.768470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f88f6-449b-46ab-8ca4-b5afd509092b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.770206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f88f6-449b-46ab-8ca4-b5afd509092b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.781755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 947/1926] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:41.785974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f88f6-449b-46ab-8ca4-b5afd509092b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.797085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:41.800923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f88f6-449b-46ab-8ca4-b5afd509092b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.806746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245e43b-cca3-4ba1-b3ef-19a68f9fbf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.807126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245e43b-cca3-4ba1-b3ef-19a68f9fbf0b admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.807393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245e43b-cca3-4ba1-b3ef-19a68f9fbf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.807831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245e43b-cca3-4ba1-b3ef-19a68f9fbf0b admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.808519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245e43b-cca3-4ba1-b3ef-19a68f9fbf0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.810300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245e43b-cca3-4ba1-b3ef-19a68f9fbf0b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.828000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 948/1927] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:41.832982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245e43b-cca3-4ba1-b3ef-19a68f9fbf0b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.847692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245e43b-cca3-4ba1-b3ef-19a68f9fbf0b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.853911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fffe5-240d-4e14-96f1-d5b5a854d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.854859 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fffe5-240d-4e14-96f1-d5b5a854d352 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.855208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fffe5-240d-4e14-96f1-d5b5a854d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.855614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fffe5-240d-4e14-96f1-d5b5a854d352 admin admin] PATH_INFO: `/v3/projects/9cfee1c6e6af4533978024c0bbea7475/users/93077e0f7c3f4a75a0feb10b25ec5325/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.876447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fffe5-240d-4e14-96f1-d5b5a854d352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfee1c6e6af4533978024c0bbea7475, user_id=93077e0f7c3f4a75a0feb10b25ec5325, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.879145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fffe5-240d-4e14-96f1-d5b5a854d352 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.917542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 980/1928] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:41 2022] POST /identity/v3/users => generated 290 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:41.919853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e35e0d-35af-4abe-803f-4ef9828375e3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.940609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e35e0d-35af-4abe-803f-4ef9828375e3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:41.951777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a489ff-117f-4775-8065-2d21e8ef005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:41.952722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a489ff-117f-4775-8065-2d21e8ef005d admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:41.952902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a489ff-117f-4775-8065-2d21e8ef005d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:41.953454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a489ff-117f-4775-8065-2d21e8ef005d admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:41.954226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a489ff-117f-4775-8065-2d21e8ef005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:41.956265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a489ff-117f-4775-8065-2d21e8ef005d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:41.977594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 981/1929] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:41.982463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a489ff-117f-4775-8065-2d21e8ef005d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:41.995196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a489ff-117f-4775-8065-2d21e8ef005d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.006092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 949/1930] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:41 2022] PUT /identity/v3/projects/9cfee1c6e6af4533978024c0bbea7475/users/93077e0f7c3f4a75a0feb10b25ec5325/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:42.019344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc7467-da79-4ad4-993b-575a977ca6ea None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.024579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc7467-da79-4ad4-993b-575a977ca6ea None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.024579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc7467-da79-4ad4-993b-575a977ca6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.078088 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e8fc7467-da79-4ad4-993b-575a977ca6ea None None] MFA Rules not processed for user `93077e0f7c3f4a75a0feb10b25ec5325`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:42.080468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e8fc7467-da79-4ad4-993b-575a977ca6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:42.100465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130600-9a05-429c-9064-6566c7393a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.101403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130600-9a05-429c-9064-6566c7393a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.101681 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130600-9a05-429c-9064-6566c7393a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.101959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130600-9a05-429c-9064-6566c7393a26 admin admin] PATH_INFO: `/v3/projects/4c1b137a5861430b945254fcd89ef3ff/users/8e61681f97b846cf88fec7b395fd964b/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.118850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84130600-9a05-429c-9064-6566c7393a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1b137a5861430b945254fcd89ef3ff, user_id=8e61681f97b846cf88fec7b395fd964b, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.121626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84130600-9a05-429c-9064-6566c7393a26 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.128357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:42.167891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 950/1931] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:42.172403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc7467-da79-4ad4-993b-575a977ca6ea None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.184199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc7467-da79-4ad4-993b-575a977ca6ea None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.189442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c061d-8321-402b-a282-306437eab2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.193669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c061d-8321-402b-a282-306437eab2fe admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.193669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c061d-8321-402b-a282-306437eab2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.193669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c061d-8321-402b-a282-306437eab2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.193669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c061d-8321-402b-a282-306437eab2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.194008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c061d-8321-402b-a282-306437eab2fe admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.291532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 982/1932] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:41 2022] PUT /identity/v3/projects/4c1b137a5861430b945254fcd89ef3ff/users/8e61681f97b846cf88fec7b395fd964b/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:42.295670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130600-9a05-429c-9064-6566c7393a26 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.321286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 951/1933] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:42 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:42.327394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c061d-8321-402b-a282-306437eab2fe admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.369394 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130600-9a05-429c-9064-6566c7393a26 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.398297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c061d-8321-402b-a282-306437eab2fe admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.403174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad91cf3-42d8-4672-a2c5-d6a7344167d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.403874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91cf3-42d8-4672-a2c5-d6a7344167d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.404162 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91cf3-42d8-4672-a2c5-d6a7344167d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.404442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91cf3-42d8-4672-a2c5-d6a7344167d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.405281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad91cf3-42d8-4672-a2c5-d6a7344167d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.407128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad91cf3-42d8-4672-a2c5-d6a7344167d8 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.428332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660cbc-2219-45c9-af69-9fb5d4a22c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.431508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660cbc-2219-45c9-af69-9fb5d4a22c26 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.431508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660cbc-2219-45c9-af69-9fb5d4a22c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.431508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660cbc-2219-45c9-af69-9fb5d4a22c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.431508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb660cbc-2219-45c9-af69-9fb5d4a22c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.432504 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb660cbc-2219-45c9-af69-9fb5d4a22c26 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.442488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 983/1934] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:42.446735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660cbc-2219-45c9-af69-9fb5d4a22c26 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.456364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660cbc-2219-45c9-af69-9fb5d4a22c26 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.461113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e57ccc-ef91-49f2-b51c-190835f1265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.461974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57ccc-ef91-49f2-b51c-190835f1265e admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.462258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57ccc-ef91-49f2-b51c-190835f1265e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.462534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57ccc-ef91-49f2-b51c-190835f1265e admin admin] PATH_INFO: `/v3/projects/4c1b137a5861430b945254fcd89ef3ff/users/8e61681f97b846cf88fec7b395fd964b/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.464577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e57ccc-ef91-49f2-b51c-190835f1265e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1b137a5861430b945254fcd89ef3ff, user_id=8e61681f97b846cf88fec7b395fd964b, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.467551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e57ccc-ef91-49f2-b51c-190835f1265e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.479059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 984/1935] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:42 2022] PUT /identity/v3/projects/4c1b137a5861430b945254fcd89ef3ff/users/8e61681f97b846cf88fec7b395fd964b/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:42.492869 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adafcd-961d-4334-a9e4-708c2380657f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.493160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adafcd-961d-4334-a9e4-708c2380657f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.493439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adafcd-961d-4334-a9e4-708c2380657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.513158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 952/1936] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:42 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:42.517145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad91cf3-42d8-4672-a2c5-d6a7344167d8 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.523500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-83adafcd-961d-4334-a9e4-708c2380657f None None] MFA Rules not processed for user `8e61681f97b846cf88fec7b395fd964b`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:42.524855 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-83adafcd-961d-4334-a9e4-708c2380657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:42.527682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad91cf3-42d8-4672-a2c5-d6a7344167d8 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.588461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a279-dde1-49ac-9182-860ce59f466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.589139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a279-dde1-49ac-9182-860ce59f466b admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.589421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a279-dde1-49ac-9182-860ce59f466b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.589699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a279-dde1-49ac-9182-860ce59f466b admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.590439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677a279-dde1-49ac-9182-860ce59f466b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.592432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677a279-dde1-49ac-9182-860ce59f466b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.603635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 953/1937] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:05:42.607876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a279-dde1-49ac-9182-860ce59f466b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.611207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 985/1938] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:42.618699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a279-dde1-49ac-9182-860ce59f466b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.623937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0229511-ccc1-41cb-8793-e558f6d628de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.624427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adafcd-961d-4334-a9e4-708c2380657f None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.624768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0229511-ccc1-41cb-8793-e558f6d628de admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.625059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0229511-ccc1-41cb-8793-e558f6d628de admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.625338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0229511-ccc1-41cb-8793-e558f6d628de admin admin] PATH_INFO: `/v3/projects/d6e23d23e3804c51b957515a967e260e/users/42d36ff996ff4ae1a4ec69dca4e915bb/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.626168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-83adafcd-961d-4334-a9e4-708c2380657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:42.642740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0229511-ccc1-41cb-8793-e558f6d628de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e23d23e3804c51b957515a967e260e, user_id=42d36ff996ff4ae1a4ec69dca4e915bb, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.645480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0229511-ccc1-41cb-8793-e558f6d628de admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.687720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adafcd-961d-4334-a9e4-708c2380657f None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.691510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab46d-a75b-437a-8a2f-4a498a14d912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.692198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab46d-a75b-437a-8a2f-4a498a14d912 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.692477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab46d-a75b-437a-8a2f-4a498a14d912 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.692749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab46d-a75b-437a-8a2f-4a498a14d912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.703376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ab46d-a75b-437a-8a2f-4a498a14d912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.704932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ab46d-a75b-437a-8a2f-4a498a14d912 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.716144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 986/1939] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:42.764227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 954/1940] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:42 2022] PUT /identity/v3/projects/d6e23d23e3804c51b957515a967e260e/users/42d36ff996ff4ae1a4ec69dca4e915bb/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:42.766694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab46d-a75b-437a-8a2f-4a498a14d912 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.785605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab46d-a75b-437a-8a2f-4a498a14d912 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.858525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0bdab-bb60-43cc-a3fa-29f93b8078dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.859204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0bdab-bb60-43cc-a3fa-29f93b8078dc admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.859497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0bdab-bb60-43cc-a3fa-29f93b8078dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.859822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0bdab-bb60-43cc-a3fa-29f93b8078dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.860557 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0bdab-bb60-43cc-a3fa-29f93b8078dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.862284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0bdab-bb60-43cc-a3fa-29f93b8078dc admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.874468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 987/1941] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:42.878922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0229511-ccc1-41cb-8793-e558f6d628de admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.896236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0229511-ccc1-41cb-8793-e558f6d628de admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.899500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0bdab-bb60-43cc-a3fa-29f93b8078dc admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:42.902918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21d17-0239-4cf3-9e68-e24b2ca53c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:42.904016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21d17-0239-4cf3-9e68-e24b2ca53c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.907379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21d17-0239-4cf3-9e68-e24b2ca53c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.907379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21d17-0239-4cf3-9e68-e24b2ca53c75 admin admin] PATH_INFO: `/v3/projects/d6e23d23e3804c51b957515a967e260e/users/42d36ff996ff4ae1a4ec69dca4e915bb/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.909742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b21d17-0239-4cf3-9e68-e24b2ca53c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e23d23e3804c51b957515a967e260e, user_id=42d36ff996ff4ae1a4ec69dca4e915bb, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:42.912779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b21d17-0239-4cf3-9e68-e24b2ca53c75 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:42.931376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 955/1942] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:42 2022] PUT /identity/v3/projects/d6e23d23e3804c51b957515a967e260e/users/42d36ff996ff4ae1a4ec69dca4e915bb/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:42.943762 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb10a32-57f1-42eb-9c95-f9b81bcd166b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:42.944069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb10a32-57f1-42eb-9c95-f9b81bcd166b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:42.946078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb10a32-57f1-42eb-9c95-f9b81bcd166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:42.985714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0bdab-bb60-43cc-a3fa-29f93b8078dc admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:42.994773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8eb10a32-57f1-42eb-9c95-f9b81bcd166b None None] MFA Rules not processed for user `42d36ff996ff4ae1a4ec69dca4e915bb`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:42.996061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8eb10a32-57f1-42eb-9c95-f9b81bcd166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:43.054620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637f15-332d-4177-a35d-a358ecc3585d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:43.055470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637f15-332d-4177-a35d-a358ecc3585d service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:43.055788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637f15-332d-4177-a35d-a358ecc3585d service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:43.056205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637f15-332d-4177-a35d-a358ecc3585d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:43.080567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 956/1943] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:43.094123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb10a32-57f1-42eb-9c95-f9b81bcd166b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:43.095715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8eb10a32-57f1-42eb-9c95-f9b81bcd166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:43.108684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb10a32-57f1-42eb-9c95-f9b81bcd166b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:43.113028 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a47bd-5c1e-40ac-8290-5d38f96c8ab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:43.113672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a47bd-5c1e-40ac-8290-5d38f96c8ab6 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:43.113960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a47bd-5c1e-40ac-8290-5d38f96c8ab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:43.114246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a47bd-5c1e-40ac-8290-5d38f96c8ab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:43.119500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637f15-332d-4177-a35d-a358ecc3585d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:43.121031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637f15-332d-4177-a35d-a358ecc3585d service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:43.129107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a47bd-5c1e-40ac-8290-5d38f96c8ab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:43.129107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a47bd-5c1e-40ac-8290-5d38f96c8ab6 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:43.133177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 988/1944] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:43.137793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 957/1945] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:43.167320 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637f15-332d-4177-a35d-a358ecc3585d service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:43.242954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637f15-332d-4177-a35d-a358ecc3585d service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:43.248287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:43.249179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:43.249468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:43.249743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] PATH_INFO: `/v3/users/93077e0f7c3f4a75a0feb10b25ec5325` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:43.250998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=93077e0f7c3f4a75a0feb10b25ec5325)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:43.253004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:43.501231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93077e0f7c3f4a75a0feb10b25ec5325'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:43.592505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93077e0f7c3f4a75a0feb10b25ec5325'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:43.601496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93077e0f7c3f4a75a0feb10b25ec5325'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:43.623589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93077e0f7c3f4a75a0feb10b25ec5325'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:43.624986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93077e0f7c3f4a75a0feb10b25ec5325'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:43.632662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 989/1946] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:43 2022] DELETE /identity/v3/users/93077e0f7c3f4a75a0feb10b25ec5325 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:43.637989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f422bd-8d14-4564-a188-2fc218d6ecff None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:43.638840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f422bd-8d14-4564-a188-2fc218d6ecff None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:43.639030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f422bd-8d14-4564-a188-2fc218d6ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:43.659380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f8f422bd-8d14-4564-a188-2fc218d6ecff None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:43.660723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f8f422bd-8d14-4564-a188-2fc218d6ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:43.730605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 958/1947] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:43.742169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:43.744862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:43.747103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:43.817102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9df5f-cc55-4366-8358-94224a2f6a5b admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:43.821194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3988ac-2df2-43ef-955b-7184ac9ff789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:43.821866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3988ac-2df2-43ef-955b-7184ac9ff789 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:43.822143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3988ac-2df2-43ef-955b-7184ac9ff789 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:43.822411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3988ac-2df2-43ef-955b-7184ac9ff789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:43.833165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3988ac-2df2-43ef-955b-7184ac9ff789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:43.834713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3988ac-2df2-43ef-955b-7184ac9ff789 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:43.851624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 990/1948] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:44.119442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:44.122720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f422bd-8d14-4564-a188-2fc218d6ecff None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:44.125170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f8f422bd-8d14-4564-a188-2fc218d6ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:44.192300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f422bd-8d14-4564-a188-2fc218d6ecff None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:44.203457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02e37a-20d2-4205-8fbe-d692b83e18c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:44.204922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e37a-20d2-4205-8fbe-d692b83e18c0 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:44.205232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e37a-20d2-4205-8fbe-d692b83e18c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:44.205409 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e37a-20d2-4205-8fbe-d692b83e18c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:44.213081 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-db02e37a-20d2-4205-8fbe-d692b83e18c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:44.317390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02e37a-20d2-4205-8fbe-d692b83e18c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:44.318868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02e37a-20d2-4205-8fbe-d692b83e18c0 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:44.343801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 959/1949] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:44.601941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3988ac-2df2-43ef-955b-7184ac9ff789 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:44.603494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7e3988ac-2df2-43ef-955b-7184ac9ff789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:44.619962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3988ac-2df2-43ef-955b-7184ac9ff789 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:44.628162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:44.629356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:44.632218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:44.632218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] PATH_INFO: `/v3/projects/9cfee1c6e6af4533978024c0bbea7475` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:44.637160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfee1c6e6af4533978024c0bbea7475)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:44.641011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:44.767434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfee1c6e6af4533978024c0bbea7475', 'request_id': 'req-57488d6e-715c-4a48-8010-c2a11679d6eb'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:44.774208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfee1c6e6af4533978024c0bbea7475', 'request_id': 'req-57488d6e-715c-4a48-8010-c2a11679d6eb'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:44.781191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfee1c6e6af4533978024c0bbea7475', 'request_id': 'req-57488d6e-715c-4a48-8010-c2a11679d6eb'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:44.882448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] The token cache is being invalidate because project 9cfee1c6e6af4533978024c0bbea7475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:44.884387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:44.884387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:44.885025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 991/1950] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:44 2022] DELETE /identity/v3/projects/9cfee1c6e6af4533978024c0bbea7475 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:44.889564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02e37a-20d2-4205-8fbe-d692b83e18c0 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:44.900800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02e37a-20d2-4205-8fbe-d692b83e18c0 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:44.966828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:44.968041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:44.968521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:44.969168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] PATH_INFO: `/v3/users/42d36ff996ff4ae1a4ec69dca4e915bb` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:44.971782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d36ff996ff4ae1a4ec69dca4e915bb)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:44.976991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:45.195523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d36ff996ff4ae1a4ec69dca4e915bb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:45.202386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d36ff996ff4ae1a4ec69dca4e915bb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:45.203079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d36ff996ff4ae1a4ec69dca4e915bb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:45.216921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d36ff996ff4ae1a4ec69dca4e915bb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:45.217660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fca88496-dfaf-427d-9b37-0bc3821bac1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d36ff996ff4ae1a4ec69dca4e915bb'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:45.305560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 960/1951] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:44 2022] DELETE /identity/v3/users/42d36ff996ff4ae1a4ec69dca4e915bb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:45.449284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:45.832710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:45.832710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:45.846329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57488d6e-715c-4a48-8010-c2a11679d6eb admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:45.912905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:45.914445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:45.914725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:45.914996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] PATH_INFO: `/v3/projects/d6e23d23e3804c51b957515a967e260e` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:45.916287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e23d23e3804c51b957515a967e260e)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:45.918634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:46.016437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e23d23e3804c51b957515a967e260e', 'request_id': 'req-d9e176c8-1aa4-4274-b855-465231d99f03'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:46.024124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e23d23e3804c51b957515a967e260e', 'request_id': 'req-d9e176c8-1aa4-4274-b855-465231d99f03'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:46.030454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e23d23e3804c51b957515a967e260e', 'request_id': 'req-d9e176c8-1aa4-4274-b855-465231d99f03'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:46.078499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:46.202727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] The token cache is being invalidate because project d6e23d23e3804c51b957515a967e260e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:46.203165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:46.203930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9e176c8-1aa4-4274-b855-465231d99f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:46.206245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 992/1952] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:45 2022] DELETE /identity/v3/projects/d6e23d23e3804c51b957515a967e260e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:46.216031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947929b8-33cd-47cf-980f-449eb7ba768e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:46.216325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947929b8-33cd-47cf-980f-449eb7ba768e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:46.216884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947929b8-33cd-47cf-980f-449eb7ba768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:46.257396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-947929b8-33cd-47cf-980f-449eb7ba768e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:46.257396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-947929b8-33cd-47cf-980f-449eb7ba768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:46.324767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 961/1953] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:46.332748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd0639-88e1-42dd-b438-6af99dea4e14 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:46.332910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd0639-88e1-42dd-b438-6af99dea4e14 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:46.333130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd0639-88e1-42dd-b438-6af99dea4e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:46.353028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5ffd0639-88e1-42dd-b438-6af99dea4e14 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:46.354218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5ffd0639-88e1-42dd-b438-6af99dea4e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:46.362269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 993/1954] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:46.369720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947929b8-33cd-47cf-980f-449eb7ba768e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:46.379538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947929b8-33cd-47cf-980f-449eb7ba768e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:46.384782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee683-2b52-4af4-878e-095c494887bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:46.385445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee683-2b52-4af4-878e-095c494887bf admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:46.385718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee683-2b52-4af4-878e-095c494887bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:46.385991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee683-2b52-4af4-878e-095c494887bf admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:46.386713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eee683-2b52-4af4-878e-095c494887bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:46.387017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eee683-2b52-4af4-878e-095c494887bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:46.388655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eee683-2b52-4af4-878e-095c494887bf admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:46.405285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 962/1955] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:05:46.406584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd0639-88e1-42dd-b438-6af99dea4e14 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:46.415997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd0639-88e1-42dd-b438-6af99dea4e14 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:46.421074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4acb5b-ca2e-4066-9d50-947065e4119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:46.421731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4acb5b-ca2e-4066-9d50-947065e4119f admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:46.422011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4acb5b-ca2e-4066-9d50-947065e4119f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:46.422283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4acb5b-ca2e-4066-9d50-947065e4119f admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:46.423621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4acb5b-ca2e-4066-9d50-947065e4119f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:46.424917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4acb5b-ca2e-4066-9d50-947065e4119f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:46.548639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 994/1956] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:46 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:46.552844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee683-2b52-4af4-878e-095c494887bf admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:46.563249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee683-2b52-4af4-878e-095c494887bf admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:46.628273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a904-0f2e-4670-a796-c2bf16c089ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:46.628944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a904-0f2e-4670-a796-c2bf16c089ce admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:46.629227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a904-0f2e-4670-a796-c2bf16c089ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:46.629495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a904-0f2e-4670-a796-c2bf16c089ce admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:46.630192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a904-0f2e-4670-a796-c2bf16c089ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:46.632910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a904-0f2e-4670-a796-c2bf16c089ce admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:46.666954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:46.748531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 963/1957] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:46 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:46.752797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4acb5b-ca2e-4066-9d50-947065e4119f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:46.766289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4acb5b-ca2e-4066-9d50-947065e4119f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:46.771107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6a17c-259a-490d-b7b3-b6047918b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:46.771825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6a17c-259a-490d-b7b3-b6047918b6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:46.772112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6a17c-259a-490d-b7b3-b6047918b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:46.772430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6a17c-259a-490d-b7b3-b6047918b6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:46.773172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6a17c-259a-490d-b7b3-b6047918b6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:46.774790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6a17c-259a-490d-b7b3-b6047918b6e9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:46.790762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 995/1958] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:46.792191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a904-0f2e-4670-a796-c2bf16c089ce admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:46.804643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a904-0f2e-4670-a796-c2bf16c089ce admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:46.809723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a11e0c-a289-4109-9baf-a5e69549709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:46.810370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11e0c-a289-4109-9baf-a5e69549709b admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:46.810720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11e0c-a289-4109-9baf-a5e69549709b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:46.811071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11e0c-a289-4109-9baf-a5e69549709b admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:46.811917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a11e0c-a289-4109-9baf-a5e69549709b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:46.813625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a11e0c-a289-4109-9baf-a5e69549709b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:46.827685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 964/1959] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:46.829726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6a17c-259a-490d-b7b3-b6047918b6e9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:46.845092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6a17c-259a-490d-b7b3-b6047918b6e9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:46.850516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9d038-28fd-4363-ae8d-5b7cd3f56289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:46.852183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9d038-28fd-4363-ae8d-5b7cd3f56289 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:46.852741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9d038-28fd-4363-ae8d-5b7cd3f56289 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:46.853024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9d038-28fd-4363-ae8d-5b7cd3f56289 admin admin] PATH_INFO: `/v3/projects/a867f3679a5f43d7bbbec06c46d85802/users/4ecbe9d19a9f4106a1a16acff41d120b/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:46.870924 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9d038-28fd-4363-ae8d-5b7cd3f56289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a867f3679a5f43d7bbbec06c46d85802, user_id=4ecbe9d19a9f4106a1a16acff41d120b, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:46.873884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9d038-28fd-4363-ae8d-5b7cd3f56289 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:47.023887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 996/1960] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:46 2022] PUT /identity/v3/projects/a867f3679a5f43d7bbbec06c46d85802/users/4ecbe9d19a9f4106a1a16acff41d120b/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:47.049933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59010c3-b4d7-48bf-b5c2-62fa0786dafc None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:47.050226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59010c3-b4d7-48bf-b5c2-62fa0786dafc None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:47.051016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59010c3-b4d7-48bf-b5c2-62fa0786dafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:47.085452 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b59010c3-b4d7-48bf-b5c2-62fa0786dafc None None] MFA Rules not processed for user `4ecbe9d19a9f4106a1a16acff41d120b`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:47.086666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b59010c3-b4d7-48bf-b5c2-62fa0786dafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:47.155412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 965/1961] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:47.160201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9d038-28fd-4363-ae8d-5b7cd3f56289 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:47.223648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9d038-28fd-4363-ae8d-5b7cd3f56289 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:47.229105 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226acdc-3e8c-41fa-8cbb-f5a81e968b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:47.229769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226acdc-3e8c-41fa-8cbb-f5a81e968b75 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:47.230059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226acdc-3e8c-41fa-8cbb-f5a81e968b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:47.230377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226acdc-3e8c-41fa-8cbb-f5a81e968b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:47.231192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226acdc-3e8c-41fa-8cbb-f5a81e968b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:47.233248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226acdc-3e8c-41fa-8cbb-f5a81e968b75 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:47.360562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 997/1962] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:47 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:47.364752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59010c3-b4d7-48bf-b5c2-62fa0786dafc None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:47.375811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59010c3-b4d7-48bf-b5c2-62fa0786dafc None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:47.431955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227de1f-a767-45e8-a48f-b4ad9690eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:47.432970 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227de1f-a767-45e8-a48f-b4ad9690eb49 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:47.433256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227de1f-a767-45e8-a48f-b4ad9690eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:47.433530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227de1f-a767-45e8-a48f-b4ad9690eb49 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:47.434237 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227de1f-a767-45e8-a48f-b4ad9690eb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:47.436365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227de1f-a767-45e8-a48f-b4ad9690eb49 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:47.518304 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 966/1963] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:47 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:47.522353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226acdc-3e8c-41fa-8cbb-f5a81e968b75 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:47.533214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226acdc-3e8c-41fa-8cbb-f5a81e968b75 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:47.538273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb9a3b-cece-4659-976d-c4bdbf0843c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:47.538933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb9a3b-cece-4659-976d-c4bdbf0843c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:47.539216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb9a3b-cece-4659-976d-c4bdbf0843c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:47.539494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb9a3b-cece-4659-976d-c4bdbf0843c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:47.540272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb9a3b-cece-4659-976d-c4bdbf0843c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:47.541871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb9a3b-cece-4659-976d-c4bdbf0843c3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:47.552555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 998/1964] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:05:47.557454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227de1f-a767-45e8-a48f-b4ad9690eb49 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:47.567883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227de1f-a767-45e8-a48f-b4ad9690eb49 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:47.573338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe3b99-0539-415c-a275-00a74db5c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:47.574465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe3b99-0539-415c-a275-00a74db5c130 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:47.574752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe3b99-0539-415c-a275-00a74db5c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:47.575034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe3b99-0539-415c-a275-00a74db5c130 admin admin] PATH_INFO: `/v3/projects/ebbce73a66114181a0605ec534b788b1/users/21dd9451b15a4cf8b72060d27dda79cf/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:47.591731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe3b99-0539-415c-a275-00a74db5c130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbce73a66114181a0605ec534b788b1, user_id=21dd9451b15a4cf8b72060d27dda79cf, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:47.594398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe3b99-0539-415c-a275-00a74db5c130 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:47.709424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 967/1965] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:47 2022] PUT /identity/v3/projects/ebbce73a66114181a0605ec534b788b1/users/21dd9451b15a4cf8b72060d27dda79cf/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:47.718600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb9a3b-cece-4659-976d-c4bdbf0843c3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:47.730093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb9a3b-cece-4659-976d-c4bdbf0843c3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:47.793667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bacb1-aca0-4a35-a0b3-e9e603a70250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:47.794334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bacb1-aca0-4a35-a0b3-e9e603a70250 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:47.794616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bacb1-aca0-4a35-a0b3-e9e603a70250 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:47.794890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bacb1-aca0-4a35-a0b3-e9e603a70250 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:47.795640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bacb1-aca0-4a35-a0b3-e9e603a70250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:47.797304 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bacb1-aca0-4a35-a0b3-e9e603a70250 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:47.812645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 999/1966] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:47.815513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe3b99-0539-415c-a275-00a74db5c130 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:47.823382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe3b99-0539-415c-a275-00a74db5c130 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:47.828165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c129e-1be5-429b-9bba-477326433df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:47.829040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c129e-1be5-429b-9bba-477326433df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:47.829318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c129e-1be5-429b-9bba-477326433df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:47.829589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c129e-1be5-429b-9bba-477326433df9 admin admin] PATH_INFO: `/v3/projects/ebbce73a66114181a0605ec534b788b1/users/21dd9451b15a4cf8b72060d27dda79cf/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:47.831661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c129e-1be5-429b-9bba-477326433df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbce73a66114181a0605ec534b788b1, user_id=21dd9451b15a4cf8b72060d27dda79cf, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:47.834425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c129e-1be5-429b-9bba-477326433df9 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:47.846342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 968/1967] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:47 2022] PUT /identity/v3/projects/ebbce73a66114181a0605ec534b788b1/users/21dd9451b15a4cf8b72060d27dda79cf/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:47.860674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd905b9-0407-4cbd-9f72-c182ed3c2891 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:47.861156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd905b9-0407-4cbd-9f72-c182ed3c2891 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:47.861303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd905b9-0407-4cbd-9f72-c182ed3c2891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:47.888380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4fd905b9-0407-4cbd-9f72-c182ed3c2891 None None] MFA Rules not processed for user `21dd9451b15a4cf8b72060d27dda79cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:47.889585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4fd905b9-0407-4cbd-9f72-c182ed3c2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:47.973063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1000/1968] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:47.987493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:48.120643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c129e-1be5-429b-9bba-477326433df9 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:48.123534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-057c129e-1be5-429b-9bba-477326433df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:48.196210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c129e-1be5-429b-9bba-477326433df9 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:48.196210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3c5b4-0f3b-45e4-9704-d799423a9f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:48.196210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c5b4-0f3b-45e4-9704-d799423a9f51 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:48.196491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c5b4-0f3b-45e4-9704-d799423a9f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:48.196563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c5b4-0f3b-45e4-9704-d799423a9f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:48.213561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3c5b4-0f3b-45e4-9704-d799423a9f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:48.215055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3c5b4-0f3b-45e4-9704-d799423a9f51 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:48.225976 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 969/1969] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:48.507554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd905b9-0407-4cbd-9f72-c182ed3c2891 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:48.518459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd905b9-0407-4cbd-9f72-c182ed3c2891 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:48.522286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be1500-1854-49c8-b449-3ee0192afc55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:48.524324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be1500-1854-49c8-b449-3ee0192afc55 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:48.524676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be1500-1854-49c8-b449-3ee0192afc55 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:48.524996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be1500-1854-49c8-b449-3ee0192afc55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:48.535049 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3c5b4-0f3b-45e4-9704-d799423a9f51 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:48.536492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5ad3c5b4-0f3b-45e4-9704-d799423a9f51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:48.592681 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be1500-1854-49c8-b449-3ee0192afc55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:48.594150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be1500-1854-49c8-b449-3ee0192afc55 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:48.603676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1001/1970] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:48.606567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3c5b4-0f3b-45e4-9704-d799423a9f51 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:48.611236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:48.612173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:48.612467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:48.612762 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] PATH_INFO: `/v3/users/af6abea1d2bc4df19c7b64d388996b7e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:48.613967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6abea1d2bc4df19c7b64d388996b7e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:48.615982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:48.812121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6abea1d2bc4df19c7b64d388996b7e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:48.820839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6abea1d2bc4df19c7b64d388996b7e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:48.821540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6abea1d2bc4df19c7b64d388996b7e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:48.836053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6abea1d2bc4df19c7b64d388996b7e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:48.836795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6abea1d2bc4df19c7b64d388996b7e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:48.902152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:48.935449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 970/1971] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:48 2022] DELETE /identity/v3/users/af6abea1d2bc4df19c7b64d388996b7e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:48.940188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1c99-0e36-42bf-9c45-66c00e679418 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:48.940482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1c99-0e36-42bf-9c45-66c00e679418 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:48.940766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1c99-0e36-42bf-9c45-66c00e679418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:48.959554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-247d1c99-0e36-42bf-9c45-66c00e679418 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:48.961375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-247d1c99-0e36-42bf-9c45-66c00e679418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:49.034059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1002/1972] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:49.041131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:49.042512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:49.104739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dae2d-1c3f-479b-9753-e1d9e4c10bc4 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:49.108507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ca3b7-37c3-4a0a-852a-5dd886dcf75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:49.109157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ca3b7-37c3-4a0a-852a-5dd886dcf75a service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:49.109445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ca3b7-37c3-4a0a-852a-5dd886dcf75a service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:49.109719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ca3b7-37c3-4a0a-852a-5dd886dcf75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:49.118832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ca3b7-37c3-4a0a-852a-5dd886dcf75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:49.120306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ca3b7-37c3-4a0a-852a-5dd886dcf75a service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:49.130611 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 971/1973] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:49.735499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d1c99-0e36-42bf-9c45-66c00e679418 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:49.737400 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-247d1c99-0e36-42bf-9c45-66c00e679418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:49.766253 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d1c99-0e36-42bf-9c45-66c00e679418 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:49.771418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:49.772353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:49.772667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:49.772936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] PATH_INFO: `/v3/projects/b00e76619450451a93d4da8d07d3918b` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:49.774380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00e76619450451a93d4da8d07d3918b)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:49.776385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:49.924617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00e76619450451a93d4da8d07d3918b', 'request_id': 'req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:49.931641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00e76619450451a93d4da8d07d3918b', 'request_id': 'req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:49.938436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00e76619450451a93d4da8d07d3918b', 'request_id': 'req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:50.020609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] The token cache is being invalidate because project b00e76619450451a93d4da8d07d3918b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:50.020896 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:50.021540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:50.023245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1003/1974] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:49 2022] DELETE /identity/v3/projects/b00e76619450451a93d4da8d07d3918b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:50.027617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ca3b7-37c3-4a0a-852a-5dd886dcf75a service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:50.040078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ca3b7-37c3-4a0a-852a-5dd886dcf75a service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:50.101215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:50.102004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:50.102287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:50.102562 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] PATH_INFO: `/v3/users/8e61681f97b846cf88fec7b395fd964b` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:50.103798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e61681f97b846cf88fec7b395fd964b)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:50.105803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:50.310139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e61681f97b846cf88fec7b395fd964b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:50.317831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e61681f97b846cf88fec7b395fd964b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:50.318568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e61681f97b846cf88fec7b395fd964b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:50.332382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e61681f97b846cf88fec7b395fd964b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:50.333142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e61681f97b846cf88fec7b395fd964b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:50.381489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:50.416220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 972/1975] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:50 2022] DELETE /identity/v3/users/8e61681f97b846cf88fec7b395fd964b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:50.812588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:50.814203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:50.826980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83b5b1-9f33-4b2e-a37f-6fabe9723a48 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:50.884284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:50.885147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:50.885427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:50.885705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] PATH_INFO: `/v3/users/ebd793031de64fd18b8eb7e297dd6b8d` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:50.886868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd793031de64fd18b8eb7e297dd6b8d)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:50.888804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:51.057397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:51.059088 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:51.075004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169747-f204-4ef9-bd30-30ce0e7ad34e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:51.080132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:51.080894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:51.081237 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:51.081429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] PATH_INFO: `/v3/projects/4c1b137a5861430b945254fcd89ef3ff` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:51.082664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1b137a5861430b945254fcd89ef3ff)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:51.084681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:51.228275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:51.289277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd793031de64fd18b8eb7e297dd6b8d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.293546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1b137a5861430b945254fcd89ef3ff', 'request_id': 'req-f814a811-ac7d-4c02-808a-7e65ea04c060'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.300715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1b137a5861430b945254fcd89ef3ff', 'request_id': 'req-f814a811-ac7d-4c02-808a-7e65ea04c060'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.306523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1b137a5861430b945254fcd89ef3ff', 'request_id': 'req-f814a811-ac7d-4c02-808a-7e65ea04c060'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.375499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd793031de64fd18b8eb7e297dd6b8d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.384144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd793031de64fd18b8eb7e297dd6b8d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.396356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd793031de64fd18b8eb7e297dd6b8d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.397105 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-8ac1279c-7dbd-4f9a-95b0-d16c501c56d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd793031de64fd18b8eb7e297dd6b8d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.405847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1004/1976] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:50 2022] DELETE /identity/v3/users/ebd793031de64fd18b8eb7e297dd6b8d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:51.408270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0c08f-a1fa-40ff-85ef-c455bdf75df4 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:51.408565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0c08f-a1fa-40ff-85ef-c455bdf75df4 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:51.408844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0c08f-a1fa-40ff-85ef-c455bdf75df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:51.426039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-73a0c08f-a1fa-40ff-85ef-c455bdf75df4 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:51.427288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-73a0c08f-a1fa-40ff-85ef-c455bdf75df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:51.448485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] The token cache is being invalidate because project 4c1b137a5861430b945254fcd89ef3ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:51.448485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.448485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f814a811-ac7d-4c02-808a-7e65ea04c060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:51.449592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 973/1977] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:51 2022] DELETE /identity/v3/projects/4c1b137a5861430b945254fcd89ef3ff => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:51.454825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74047a0-6881-49ce-ad39-1e6a0dddfe3b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:51.455253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74047a0-6881-49ce-ad39-1e6a0dddfe3b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:51.455759 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74047a0-6881-49ce-ad39-1e6a0dddfe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:51.477417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b74047a0-6881-49ce-ad39-1e6a0dddfe3b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:51.478798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b74047a0-6881-49ce-ad39-1e6a0dddfe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:51.497556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1005/1978] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:51.507326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0c08f-a1fa-40ff-85ef-c455bdf75df4 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:51.513922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 974/1979] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:51.514256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-73a0c08f-a1fa-40ff-85ef-c455bdf75df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:51.515377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b84c3-a14e-4402-9ba5-873a857f8f68 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:51.515705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b84c3-a14e-4402-9ba5-873a857f8f68 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:51.516036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b84c3-a14e-4402-9ba5-873a857f8f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:51.537094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b73b84c3-a14e-4402-9ba5-873a857f8f68 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:51.538373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b73b84c3-a14e-4402-9ba5-873a857f8f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:51.546699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 975/1980] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:51.551041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b84c3-a14e-4402-9ba5-873a857f8f68 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:51.560570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b84c3-a14e-4402-9ba5-873a857f8f68 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:51.565913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcedf7-524d-4932-aec4-2545a1b3b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:51.566444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcedf7-524d-4932-aec4-2545a1b3b983 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:51.566730 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcedf7-524d-4932-aec4-2545a1b3b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:51.567007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcedf7-524d-4932-aec4-2545a1b3b983 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:51.567869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcedf7-524d-4932-aec4-2545a1b3b983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:51.568184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcedf7-524d-4932-aec4-2545a1b3b983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:51.570352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcedf7-524d-4932-aec4-2545a1b3b983 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:51.575514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0c08f-a1fa-40ff-85ef-c455bdf75df4 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:51.579617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095def-0e20-4ba7-abc9-26ef4e852bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:51.580304 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095def-0e20-4ba7-abc9-26ef4e852bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:51.580596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095def-0e20-4ba7-abc9-26ef4e852bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:51.580880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095def-0e20-4ba7-abc9-26ef4e852bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:51.583617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 976/1981] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:05:51.589664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcedf7-524d-4932-aec4-2545a1b3b983 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:51.591289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095def-0e20-4ba7-abc9-26ef4e852bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:51.593197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095def-0e20-4ba7-abc9-26ef4e852bf6 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:51.601615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcedf7-524d-4932-aec4-2545a1b3b983 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:51.604280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1006/1982] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:51.610376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519af2-ae5d-4a91-ac67-7ea5f99b6978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:51.611208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519af2-ae5d-4a91-ac67-7ea5f99b6978 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:51.611489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519af2-ae5d-4a91-ac67-7ea5f99b6978 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:51.611811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519af2-ae5d-4a91-ac67-7ea5f99b6978 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:51.612540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f519af2-ae5d-4a91-ac67-7ea5f99b6978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:51.614516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f519af2-ae5d-4a91-ac67-7ea5f99b6978 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:51.732121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 977/1983] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:51 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:51.736941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095def-0e20-4ba7-abc9-26ef4e852bf6 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:51.749233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095def-0e20-4ba7-abc9-26ef4e852bf6 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:51.818742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f530d82-52c7-4a6f-a504-5591da9de43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:51.819819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f530d82-52c7-4a6f-a504-5591da9de43d admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:51.820176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f530d82-52c7-4a6f-a504-5591da9de43d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:51.820532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f530d82-52c7-4a6f-a504-5591da9de43d admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:51.821487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f530d82-52c7-4a6f-a504-5591da9de43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:51.823823 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f530d82-52c7-4a6f-a504-5591da9de43d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:51.944677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1007/1984] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:51 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:51.950071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519af2-ae5d-4a91-ac67-7ea5f99b6978 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:51.962084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519af2-ae5d-4a91-ac67-7ea5f99b6978 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:51.967353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d8a2-59ef-4f1c-8912-a4515feb57a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:51.968080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d8a2-59ef-4f1c-8912-a4515feb57a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:51.968363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d8a2-59ef-4f1c-8912-a4515feb57a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:51.968632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d8a2-59ef-4f1c-8912-a4515feb57a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:51.969343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00d8a2-59ef-4f1c-8912-a4515feb57a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:51.971220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00d8a2-59ef-4f1c-8912-a4515feb57a0 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:51.982882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 978/1985] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:05:51.991073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f530d82-52c7-4a6f-a504-5591da9de43d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:52.006107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f530d82-52c7-4a6f-a504-5591da9de43d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:52.014377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57786f-9485-429b-8ab7-ff31ca7787d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:52.014817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57786f-9485-429b-8ab7-ff31ca7787d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.015104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57786f-9485-429b-8ab7-ff31ca7787d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.015419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57786f-9485-429b-8ab7-ff31ca7787d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.016187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57786f-9485-429b-8ab7-ff31ca7787d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:52.017883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57786f-9485-429b-8ab7-ff31ca7787d0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:52.031624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1008/1986] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:52.037562 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d8a2-59ef-4f1c-8912-a4515feb57a0 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:52.049357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d8a2-59ef-4f1c-8912-a4515feb57a0 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:52.069805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f71a8-ff73-4e81-9d89-15c7d1b2b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:52.070749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f71a8-ff73-4e81-9d89-15c7d1b2b821 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.071016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f71a8-ff73-4e81-9d89-15c7d1b2b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.071307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f71a8-ff73-4e81-9d89-15c7d1b2b821 admin admin] PATH_INFO: `/v3/projects/4009a049202443f098a73681a094d9b9/users/ad46e443a3b84e3b8de09967f8dc8fde/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.088848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f71a8-ff73-4e81-9d89-15c7d1b2b821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4009a049202443f098a73681a094d9b9, user_id=ad46e443a3b84e3b8de09967f8dc8fde, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:52.092760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f71a8-ff73-4e81-9d89-15c7d1b2b821 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:52.245952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 979/1987] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:52 2022] PUT /identity/v3/projects/4009a049202443f098a73681a094d9b9/users/ad46e443a3b84e3b8de09967f8dc8fde/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:52.246619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57786f-9485-429b-8ab7-ff31ca7787d0 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:52.248413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ea57786f-9485-429b-8ab7-ff31ca7787d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:52.256035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d765e-e328-4c96-9c17-c8103f3201d5 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.256555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d765e-e328-4c96-9c17-c8103f3201d5 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.257193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d765e-e328-4c96-9c17-c8103f3201d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.272488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57786f-9485-429b-8ab7-ff31ca7787d0 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:52.295484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0d1d765e-e328-4c96-9c17-c8103f3201d5 None None] MFA Rules not processed for user `ad46e443a3b84e3b8de09967f8dc8fde`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:52.296994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0d1d765e-e328-4c96-9c17-c8103f3201d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:52.329990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:52.330785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.331056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.331322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] PATH_INFO: `/v3/projects/be8129febbc641b397065be444169ae4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.332604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8129febbc641b397065be444169ae4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:52.334569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:52.368950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 980/1988] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:52.379849 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d765e-e328-4c96-9c17-c8103f3201d5 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:52.384410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d765e-e328-4c96-9c17-c8103f3201d5 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:52.389226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a33df5-b844-4a19-b5e1-aeb55e195317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:52.389984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a33df5-b844-4a19-b5e1-aeb55e195317 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.390271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a33df5-b844-4a19-b5e1-aeb55e195317 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.390551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a33df5-b844-4a19-b5e1-aeb55e195317 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.391323 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a33df5-b844-4a19-b5e1-aeb55e195317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:52.393275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a33df5-b844-4a19-b5e1-aeb55e195317 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:52.521111 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 981/1989] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:52 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:52.525717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a33df5-b844-4a19-b5e1-aeb55e195317 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:52.533922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8129febbc641b397065be444169ae4', 'request_id': 'req-7e24d18a-c28c-4c34-9427-404411454232'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:52.542520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8129febbc641b397065be444169ae4', 'request_id': 'req-7e24d18a-c28c-4c34-9427-404411454232'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:52.548860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8129febbc641b397065be444169ae4', 'request_id': 'req-7e24d18a-c28c-4c34-9427-404411454232'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:52.595690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a33df5-b844-4a19-b5e1-aeb55e195317 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:52.601240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f18a-c415-4be3-8607-85c81623ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:52.601791 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f18a-c415-4be3-8607-85c81623ef5a admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.602083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f18a-c415-4be3-8607-85c81623ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.602356 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f18a-c415-4be3-8607-85c81623ef5a admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.603060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400f18a-c415-4be3-8607-85c81623ef5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:52.605045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400f18a-c415-4be3-8607-85c81623ef5a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:52.660903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] The token cache is being invalidate because project be8129febbc641b397065be444169ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:52.661196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:52.661844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:52.664018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1009/1990] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:52 2022] DELETE /identity/v3/projects/be8129febbc641b397065be444169ae4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:52.667852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:52.669223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:52.705527 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 982/1991] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:52 2022] POST /identity/v3/users => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:05:52.706924 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f18a-c415-4be3-8607-85c81623ef5a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:52.709099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6400f18a-c415-4be3-8607-85c81623ef5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:52.722327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f18a-c415-4be3-8607-85c81623ef5a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:52.728095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d600e-8e86-4cfa-bb61-12f6ce6d6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:52.728780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d600e-8e86-4cfa-bb61-12f6ce6d6410 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.729064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d600e-8e86-4cfa-bb61-12f6ce6d6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.729365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d600e-8e86-4cfa-bb61-12f6ce6d6410 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.730080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d600e-8e86-4cfa-bb61-12f6ce6d6410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:52.731733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d600e-8e86-4cfa-bb61-12f6ce6d6410 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:52.742984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 983/1992] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:05:52.747269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d600e-8e86-4cfa-bb61-12f6ce6d6410 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:52.751657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d18a-c28c-4c34-9427-404411454232 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:52.756419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:52.757800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.758083 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.758185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d600e-8e86-4cfa-bb61-12f6ce6d6410 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:52.758356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] PATH_INFO: `/v3/users/a93994cc83d4406abf9c18af5e7f5a61` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.759579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93994cc83d4406abf9c18af5e7f5a61)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:52.761564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:52.764319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bc980-2b7f-48ac-9f25-208ddb1ed968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:52.765230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bc980-2b7f-48ac-9f25-208ddb1ed968 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.765523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bc980-2b7f-48ac-9f25-208ddb1ed968 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.765847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bc980-2b7f-48ac-9f25-208ddb1ed968 admin admin] PATH_INFO: `/v3/projects/4e6db77ed22f476699b326d46b754e11/users/08a659d23dba42bd83007a6d7cbe621c/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.783468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bc980-2b7f-48ac-9f25-208ddb1ed968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6db77ed22f476699b326d46b754e11, user_id=08a659d23dba42bd83007a6d7cbe621c, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:52.786270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bc980-2b7f-48ac-9f25-208ddb1ed968 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:52.954636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 984/1993] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:52 2022] PUT /identity/v3/projects/4e6db77ed22f476699b326d46b754e11/users/08a659d23dba42bd83007a6d7cbe621c/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:52.959065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bc980-2b7f-48ac-9f25-208ddb1ed968 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:53.034118 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93994cc83d4406abf9c18af5e7f5a61'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:53.047015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bc980-2b7f-48ac-9f25-208ddb1ed968 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:53.052367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de67ab-08e3-4d88-81c5-7f5aefea1a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:53.053129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de67ab-08e3-4d88-81c5-7f5aefea1a79 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:53.053415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de67ab-08e3-4d88-81c5-7f5aefea1a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:53.053835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de67ab-08e3-4d88-81c5-7f5aefea1a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:53.054573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de67ab-08e3-4d88-81c5-7f5aefea1a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:53.056261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de67ab-08e3-4d88-81c5-7f5aefea1a79 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:53.067605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 985/1994] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:53.072471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de67ab-08e3-4d88-81c5-7f5aefea1a79 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:53.082662 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de67ab-08e3-4d88-81c5-7f5aefea1a79 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:53.087926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1563-5db6-409b-965f-ad4cf52ec970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:53.088807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1563-5db6-409b-965f-ad4cf52ec970 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:53.089089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1563-5db6-409b-965f-ad4cf52ec970 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:53.089367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1563-5db6-409b-965f-ad4cf52ec970 admin admin] PATH_INFO: `/v3/projects/4e6db77ed22f476699b326d46b754e11/users/08a659d23dba42bd83007a6d7cbe621c/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:53.091713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1563-5db6-409b-965f-ad4cf52ec970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6db77ed22f476699b326d46b754e11, user_id=08a659d23dba42bd83007a6d7cbe621c, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:53.094424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1563-5db6-409b-965f-ad4cf52ec970 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:53.105060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 986/1995] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:53 2022] PUT /identity/v3/projects/4e6db77ed22f476699b326d46b754e11/users/08a659d23dba42bd83007a6d7cbe621c/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:53.120192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756bb5-1ecc-4e12-b3ef-49021adcd98f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:53.120484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756bb5-1ecc-4e12-b3ef-49021adcd98f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:53.120765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756bb5-1ecc-4e12-b3ef-49021adcd98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:53.140970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93994cc83d4406abf9c18af5e7f5a61'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:53.155923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-81756bb5-1ecc-4e12-b3ef-49021adcd98f None None] MFA Rules not processed for user `08a659d23dba42bd83007a6d7cbe621c`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:53.156375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93994cc83d4406abf9c18af5e7f5a61'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:53.156473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-81756bb5-1ecc-4e12-b3ef-49021adcd98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:53.166936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93994cc83d4406abf9c18af5e7f5a61'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:53.167747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93994cc83d4406abf9c18af5e7f5a61'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:53.175188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1010/1996] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:52 2022] DELETE /identity/v3/users/a93994cc83d4406abf9c18af5e7f5a61 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:05:53.259240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 987/1997] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:53.276378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:53.278555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:53.344463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621582f-c6e2-401e-8dd5-528a73e103c6 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:53.348163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b9a1a-cee3-491f-8c5e-72911bcff123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:53.348812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b9a1a-cee3-491f-8c5e-72911bcff123 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:53.349095 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b9a1a-cee3-491f-8c5e-72911bcff123 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:53.349403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b9a1a-cee3-491f-8c5e-72911bcff123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:53.409593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b9a1a-cee3-491f-8c5e-72911bcff123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:53.413503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b9a1a-cee3-491f-8c5e-72911bcff123 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:53.421001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1011/1998] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:53.433173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:53.500465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756bb5-1ecc-4e12-b3ef-49021adcd98f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:53.563887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756bb5-1ecc-4e12-b3ef-49021adcd98f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:53.568418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72bda5-bbca-48fa-8e2e-517bc72663de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:53.568418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72bda5-bbca-48fa-8e2e-517bc72663de service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:53.568640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72bda5-bbca-48fa-8e2e-517bc72663de service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:53.568728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72bda5-bbca-48fa-8e2e-517bc72663de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:53.571078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4f72bda5-bbca-48fa-8e2e-517bc72663de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:53.634911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72bda5-bbca-48fa-8e2e-517bc72663de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:53.637025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72bda5-bbca-48fa-8e2e-517bc72663de service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:53.648538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 988/1999] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:53.742708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b9a1a-cee3-491f-8c5e-72911bcff123 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:53.744649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e74b9a1a-cee3-491f-8c5e-72911bcff123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:53.839704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b9a1a-cee3-491f-8c5e-72911bcff123 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:53.844733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:53.856099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:53.856099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:53.856099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] PATH_INFO: `/v3/projects/9da0e8fb743b4637a1897c9911368a4e` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:53.856099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da0e8fb743b4637a1897c9911368a4e)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:53.856099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:53.935346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:54.004686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da0e8fb743b4637a1897c9911368a4e', 'request_id': 'req-262f7155-b88a-4f4e-a7c8-7280d557c308'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:54.012471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da0e8fb743b4637a1897c9911368a4e', 'request_id': 'req-262f7155-b88a-4f4e-a7c8-7280d557c308'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:54.019291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da0e8fb743b4637a1897c9911368a4e', 'request_id': 'req-262f7155-b88a-4f4e-a7c8-7280d557c308'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:54.099041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] The token cache is being invalidate because project 9da0e8fb743b4637a1897c9911368a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:54.099546 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:54.100615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-262f7155-b88a-4f4e-a7c8-7280d557c308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:54.103168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1012/2000] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:53 2022] DELETE /identity/v3/projects/9da0e8fb743b4637a1897c9911368a4e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:54.109699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd3107-3918-4459-870e-6e02f8f3cc25 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.110042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd3107-3918-4459-870e-6e02f8f3cc25 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.110381 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd3107-3918-4459-870e-6e02f8f3cc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.132473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f1bd3107-3918-4459-870e-6e02f8f3cc25 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:54.133837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f1bd3107-3918-4459-870e-6e02f8f3cc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:54.210737 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 989/2001] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:54.225038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104356f5-549b-49ff-8016-375b0bb17042 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.225405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104356f5-549b-49ff-8016-375b0bb17042 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.225747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104356f5-549b-49ff-8016-375b0bb17042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.246542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-104356f5-549b-49ff-8016-375b0bb17042 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:54.247809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-104356f5-549b-49ff-8016-375b0bb17042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:54.259389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1013/2002] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:54.264287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd3107-3918-4459-870e-6e02f8f3cc25 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:54.281847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd3107-3918-4459-870e-6e02f8f3cc25 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:54.287321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc87b3-0278-4ffa-b78d-49661851e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:54.288733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc87b3-0278-4ffa-b78d-49661851e128 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.289038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc87b3-0278-4ffa-b78d-49661851e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.289322 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc87b3-0278-4ffa-b78d-49661851e128 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.290059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc87b3-0278-4ffa-b78d-49661851e128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:05:54.290366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc87b3-0278-4ffa-b78d-49661851e128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:54.292061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc87b3-0278-4ffa-b78d-49661851e128 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:54.314523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 990/2003] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:05:54.316098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104356f5-549b-49ff-8016-375b0bb17042 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:54.328017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104356f5-549b-49ff-8016-375b0bb17042 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:54.333289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0806-86f3-4093-9fe5-3c2a8accf04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:54.334027 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0806-86f3-4093-9fe5-3c2a8accf04f admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.334387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0806-86f3-4093-9fe5-3c2a8accf04f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.334707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0806-86f3-4093-9fe5-3c2a8accf04f admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.335954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b0806-86f3-4093-9fe5-3c2a8accf04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:54.337973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b0806-86f3-4093-9fe5-3c2a8accf04f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:54.502892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1014/2004] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:05:54 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:54.508315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc87b3-0278-4ffa-b78d-49661851e128 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:54.521864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc87b3-0278-4ffa-b78d-49661851e128 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:54.548012 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:54.620493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bd313-1574-4b30-87af-66efe13aa48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:54.621196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bd313-1574-4b30-87af-66efe13aa48e admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.621489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bd313-1574-4b30-87af-66efe13aa48e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.621770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bd313-1574-4b30-87af-66efe13aa48e admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.622494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bd313-1574-4b30-87af-66efe13aa48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:54.624481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bd313-1574-4b30-87af-66efe13aa48e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:54.736615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 991/2005] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:05:54 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:05:54.741945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0806-86f3-4093-9fe5-3c2a8accf04f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:54.754615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0806-86f3-4093-9fe5-3c2a8accf04f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:54.764652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd0181-0875-49cc-ba73-6cea595d0eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:54.765386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd0181-0875-49cc-ba73-6cea595d0eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.765692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd0181-0875-49cc-ba73-6cea595d0eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.765991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd0181-0875-49cc-ba73-6cea595d0eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.766756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd0181-0875-49cc-ba73-6cea595d0eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:54.768532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd0181-0875-49cc-ba73-6cea595d0eb7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:54.787392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1015/2006] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:54.788636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bd313-1574-4b30-87af-66efe13aa48e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:54.807366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bd313-1574-4b30-87af-66efe13aa48e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:54.823502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84295-d1e1-4e5b-ab1e-7cdd19ca4062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:54.824865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84295-d1e1-4e5b-ab1e-7cdd19ca4062 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.824865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84295-d1e1-4e5b-ab1e-7cdd19ca4062 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.824865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84295-d1e1-4e5b-ab1e-7cdd19ca4062 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.826317 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b84295-d1e1-4e5b-ab1e-7cdd19ca4062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:54.826500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd0181-0875-49cc-ba73-6cea595d0eb7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:54.827972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b84295-d1e1-4e5b-ab1e-7cdd19ca4062 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:54.833588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-61bd0181-0875-49cc-ba73-6cea595d0eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:54.839955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 992/2007] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:05:54.845093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84295-d1e1-4e5b-ab1e-7cdd19ca4062 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:54.857112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84295-d1e1-4e5b-ab1e-7cdd19ca4062 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:54.865342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad29a70-7a91-4a9a-9a1c-5b397805027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:54.867714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad29a70-7a91-4a9a-9a1c-5b397805027e admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.868001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad29a70-7a91-4a9a-9a1c-5b397805027e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.868278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad29a70-7a91-4a9a-9a1c-5b397805027e admin admin] PATH_INFO: `/v3/projects/f9e17a993c774c7ea1bc8736c73d0a80/users/310b63d274564b55820dc798cf961519/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.887832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad29a70-7a91-4a9a-9a1c-5b397805027e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e17a993c774c7ea1bc8736c73d0a80, user_id=310b63d274564b55820dc798cf961519, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:54.893970 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad29a70-7a91-4a9a-9a1c-5b397805027e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:54.909132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd0181-0875-49cc-ba73-6cea595d0eb7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:54.913795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ae75c-b521-4b05-9164-d545a4c3f226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:54.914449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae75c-b521-4b05-9164-d545a4c3f226 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:54.914725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae75c-b521-4b05-9164-d545a4c3f226 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:54.915150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae75c-b521-4b05-9164-d545a4c3f226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:54.916847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c25ae75c-b521-4b05-9164-d545a4c3f226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:54.990508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ae75c-b521-4b05-9164-d545a4c3f226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:54.992028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ae75c-b521-4b05-9164-d545a4c3f226 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:55.002825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1016/2008] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:55.004995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 993/2009] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:05:54 2022] PUT /identity/v3/projects/f9e17a993c774c7ea1bc8736c73d0a80/users/310b63d274564b55820dc798cf961519/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:55.018522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c6cff-e31b-4553-9d7b-fc4f27504157 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:55.018813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c6cff-e31b-4553-9d7b-fc4f27504157 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:55.019093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c6cff-e31b-4553-9d7b-fc4f27504157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:55.050282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-057c6cff-e31b-4553-9d7b-fc4f27504157 None None] MFA Rules not processed for user `310b63d274564b55820dc798cf961519`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:55.051488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-057c6cff-e31b-4553-9d7b-fc4f27504157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:55.161355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1017/2010] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:05:55.237995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad29a70-7a91-4a9a-9a1c-5b397805027e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:55.315608 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad29a70-7a91-4a9a-9a1c-5b397805027e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:55.321729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a1501-741e-456c-864c-30664272b53b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:55.321729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a1501-741e-456c-864c-30664272b53b service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:55.321729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a1501-741e-456c-864c-30664272b53b service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:55.323470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a1501-741e-456c-864c-30664272b53b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:55.336211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a1501-741e-456c-864c-30664272b53b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:55.338222 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a1501-741e-456c-864c-30664272b53b service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:55.349241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 994/2011] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:55.850039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:56.168061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:58.540861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c6cff-e31b-4553-9d7b-fc4f27504157 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:58.542336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-057c6cff-e31b-4553-9d7b-fc4f27504157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:58.609022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c6cff-e31b-4553-9d7b-fc4f27504157 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:58.613483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:58.614342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:58.614629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:58.614898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] PATH_INFO: `/v3/users/4ecbe9d19a9f4106a1a16acff41d120b` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:58.616149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ecbe9d19a9f4106a1a16acff41d120b)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:58.618072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:58.677876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:58.863327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ecbe9d19a9f4106a1a16acff41d120b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:58.969949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ecbe9d19a9f4106a1a16acff41d120b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:58.981739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ecbe9d19a9f4106a1a16acff41d120b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:58.998277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ecbe9d19a9f4106a1a16acff41d120b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:58.999061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ecbe9d19a9f4106a1a16acff41d120b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:59.005914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1018/2012] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:58 2022] DELETE /identity/v3/users/4ecbe9d19a9f4106a1a16acff41d120b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:59.011228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896f0b0-cb57-4bc6-87ec-6fb058927a78 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:59.011707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896f0b0-cb57-4bc6-87ec-6fb058927a78 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:59.011909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896f0b0-cb57-4bc6-87ec-6fb058927a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:59.046513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3896f0b0-cb57-4bc6-87ec-6fb058927a78 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:59.048142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3896f0b0-cb57-4bc6-87ec-6fb058927a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:59.064453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:59.121050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 995/2013] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:59.131095 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:59.133547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:59.210385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ad8a-c944-46fc-96d0-9b33995eda3d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:59.224625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c72c-825e-420e-8e4c-594ffc8e1fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:59.225620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c72c-825e-420e-8e4c-594ffc8e1fed service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:59.226002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c72c-825e-420e-8e4c-594ffc8e1fed service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:59.226587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c72c-825e-420e-8e4c-594ffc8e1fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:59.241430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c72c-825e-420e-8e4c-594ffc8e1fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:59.243150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c72c-825e-420e-8e4c-594ffc8e1fed service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:59.254249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1019/2014] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:59.896496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896f0b0-cb57-4bc6-87ec-6fb058927a78 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:59.898622 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3896f0b0-cb57-4bc6-87ec-6fb058927a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:59.911635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896f0b0-cb57-4bc6-87ec-6fb058927a78 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:59.916571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:59.920779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:59.920779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:59.920779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] PATH_INFO: `/v3/projects/a867f3679a5f43d7bbbec06c46d85802` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:59.920779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a867f3679a5f43d7bbbec06c46d85802)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:59.921592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:59.982352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c72c-825e-420e-8e4c-594ffc8e1fed service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:59.984918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ca86c72c-825e-420e-8e4c-594ffc8e1fed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:00.000365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c72c-825e-420e-8e4c-594ffc8e1fed service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:00.008524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:00.012300 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:00.012300 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:00.012300 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] PATH_INFO: `/v3/users/ad46e443a3b84e3b8de09967f8dc8fde` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:00.012300 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad46e443a3b84e3b8de09967f8dc8fde)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:00.013573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:00.052590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a867f3679a5f43d7bbbec06c46d85802', 'request_id': 'req-2fd79903-97fc-4adf-aa86-724d21d34206'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.068423 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a867f3679a5f43d7bbbec06c46d85802', 'request_id': 'req-2fd79903-97fc-4adf-aa86-724d21d34206'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.075961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a867f3679a5f43d7bbbec06c46d85802', 'request_id': 'req-2fd79903-97fc-4adf-aa86-724d21d34206'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.290900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] The token cache is being invalidate because project a867f3679a5f43d7bbbec06c46d85802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:00.291804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.292734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.294875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 996/2015] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:05:59 2022] DELETE /identity/v3/projects/a867f3679a5f43d7bbbec06c46d85802 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:00.300963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:00.303150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:00.406616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad46e443a3b84e3b8de09967f8dc8fde'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.409585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79903-97fc-4adf-aa86-724d21d34206 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:00.416419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:00.417342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:00.417654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:00.417933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] PATH_INFO: `/v3/users/21dd9451b15a4cf8b72060d27dda79cf` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:00.419410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21dd9451b15a4cf8b72060d27dda79cf)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:00.421851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:00.564364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad46e443a3b84e3b8de09967f8dc8fde'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.572540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad46e443a3b84e3b8de09967f8dc8fde'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.590158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad46e443a3b84e3b8de09967f8dc8fde'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.590912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ba91db78-ae06-480d-8e2c-613f18db5792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad46e443a3b84e3b8de09967f8dc8fde'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.598016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1020/2016] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:05:59 2022] DELETE /identity/v3/users/ad46e443a3b84e3b8de09967f8dc8fde => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:00.603065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9163b-fb07-4f0e-9127-b8159fce320b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:00.603366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9163b-fb07-4f0e-9127-b8159fce320b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:00.603693 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9163b-fb07-4f0e-9127-b8159fce320b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:00.622754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-6be9163b-fb07-4f0e-9127-b8159fce320b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:00.624077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6be9163b-fb07-4f0e-9127-b8159fce320b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:00.687766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1021/2017] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:00.697556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9163b-fb07-4f0e-9127-b8159fce320b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:00.698986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6be9163b-fb07-4f0e-9127-b8159fce320b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:00.760689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21dd9451b15a4cf8b72060d27dda79cf'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.763676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9163b-fb07-4f0e-9127-b8159fce320b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:00.767897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae4431-ae42-44b5-87b2-2bf8814d0fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:00.768616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae4431-ae42-44b5-87b2-2bf8814d0fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:00.768904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae4431-ae42-44b5-87b2-2bf8814d0fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:00.769183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae4431-ae42-44b5-87b2-2bf8814d0fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:00.772658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21dd9451b15a4cf8b72060d27dda79cf'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.773699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21dd9451b15a4cf8b72060d27dda79cf'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.793597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae4431-ae42-44b5-87b2-2bf8814d0fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:00.794866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae4431-ae42-44b5-87b2-2bf8814d0fd9 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:00.800150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21dd9451b15a4cf8b72060d27dda79cf'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.801377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21dd9451b15a4cf8b72060d27dda79cf'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:00.827249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1022/2018] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:06:01.004677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 997/2019] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:00 2022] DELETE /identity/v3/users/21dd9451b15a4cf8b72060d27dda79cf => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:01.443766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae4431-ae42-44b5-87b2-2bf8814d0fd9 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:01.446733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d6ae4431-ae42-44b5-87b2-2bf8814d0fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:01.478780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae4431-ae42-44b5-87b2-2bf8814d0fd9 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:01.568423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:01.569945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:01.570215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:01.570486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] PATH_INFO: `/v3/projects/4009a049202443f098a73681a094d9b9` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:01.571817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4009a049202443f098a73681a094d9b9)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:01.573935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:01.654020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:01.655760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:01.674331 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aabb7c-6c2d-4605-a21c-b18c45d57444 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:01.680421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:01.681303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:01.681590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:01.682014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] PATH_INFO: `/v3/projects/ebbce73a66114181a0605ec534b788b1` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:01.683308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbce73a66114181a0605ec534b788b1)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:01.685330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:01.753440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4009a049202443f098a73681a094d9b9', 'request_id': 'req-82486ba5-18ac-4a67-b59d-1ec5242c94ff'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:01.760480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4009a049202443f098a73681a094d9b9', 'request_id': 'req-82486ba5-18ac-4a67-b59d-1ec5242c94ff'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:01.766212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4009a049202443f098a73681a094d9b9', 'request_id': 'req-82486ba5-18ac-4a67-b59d-1ec5242c94ff'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:01.769681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:01.863729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbce73a66114181a0605ec534b788b1', 'request_id': 'req-3927a8f1-a947-4005-aa93-ae4125dea547'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:01.871907 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbce73a66114181a0605ec534b788b1', 'request_id': 'req-3927a8f1-a947-4005-aa93-ae4125dea547'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:01.878276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbce73a66114181a0605ec534b788b1', 'request_id': 'req-3927a8f1-a947-4005-aa93-ae4125dea547'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:01.899155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] The token cache is being invalidate because project 4009a049202443f098a73681a094d9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:01.899155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:01.899155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:01.899531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1023/2020] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:01 2022] DELETE /identity/v3/projects/4009a049202443f098a73681a094d9b9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:01.904059 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:01.905584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:01.979405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82486ba5-18ac-4a67-b59d-1ec5242c94ff admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:02.049338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] The token cache is being invalidate because project ebbce73a66114181a0605ec534b788b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:02.049801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.050413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-3927a8f1-a947-4005-aa93-ae4125dea547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.050787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:02.052455 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 998/2021] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:01 2022] DELETE /identity/v3/projects/ebbce73a66114181a0605ec534b788b1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:02.054761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.055067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.055351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] PATH_INFO: `/v3/users/08a659d23dba42bd83007a6d7cbe621c` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.056723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a659d23dba42bd83007a6d7cbe621c)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:02.057619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac5a2c-aad8-42f1-a4da-216a9c1982c4 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.057991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac5a2c-aad8-42f1-a4da-216a9c1982c4 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.058270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac5a2c-aad8-42f1-a4da-216a9c1982c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.058688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:02.087684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-36ac5a2c-aad8-42f1-a4da-216a9c1982c4 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:02.088851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-36ac5a2c-aad8-42f1-a4da-216a9c1982c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:02.097229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 999/2022] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:02.105022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861ea6-8094-4dfe-a20b-c5d671d286e2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.105311 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861ea6-8094-4dfe-a20b-c5d671d286e2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.105588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861ea6-8094-4dfe-a20b-c5d671d286e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.124159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-2c861ea6-8094-4dfe-a20b-c5d671d286e2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:02.125059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2c861ea6-8094-4dfe-a20b-c5d671d286e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:02.134082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1000/2023] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:02.138182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861ea6-8094-4dfe-a20b-c5d671d286e2 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.147955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861ea6-8094-4dfe-a20b-c5d671d286e2 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:02.155913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3c0a1-fc87-4656-a7fb-95fba282be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:02.156796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c0a1-fc87-4656-a7fb-95fba282be5a admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.157077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c0a1-fc87-4656-a7fb-95fba282be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.157354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c0a1-fc87-4656-a7fb-95fba282be5a admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.158085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3c0a1-fc87-4656-a7fb-95fba282be5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:06:02.158393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3c0a1-fc87-4656-a7fb-95fba282be5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:02.160057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3c0a1-fc87-4656-a7fb-95fba282be5a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:02.169912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:02.171972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1001/2024] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:06:02.176596 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3c0a1-fc87-4656-a7fb-95fba282be5a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.188027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3c0a1-fc87-4656-a7fb-95fba282be5a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:02.192895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1acdc-3542-44bf-beff-459e72dc717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:02.193555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1acdc-3542-44bf-beff-459e72dc717f admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.193875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1acdc-3542-44bf-beff-459e72dc717f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.194776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1acdc-3542-44bf-beff-459e72dc717f admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.195457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1acdc-3542-44bf-beff-459e72dc717f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:02.197583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1acdc-3542-44bf-beff-459e72dc717f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:02.319596 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1002/2025] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:02 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:02.324243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1acdc-3542-44bf-beff-459e72dc717f admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.367991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a659d23dba42bd83007a6d7cbe621c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.398135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1acdc-3542-44bf-beff-459e72dc717f admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:02.404512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c8e8c-8c66-49ee-b265-2b33d9932516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:02.405399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c8e8c-8c66-49ee-b265-2b33d9932516 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.405810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c8e8c-8c66-49ee-b265-2b33d9932516 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.406211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c8e8c-8c66-49ee-b265-2b33d9932516 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.407259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c8e8c-8c66-49ee-b265-2b33d9932516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:02.409799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c8e8c-8c66-49ee-b265-2b33d9932516 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:02.432133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a659d23dba42bd83007a6d7cbe621c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.439594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a659d23dba42bd83007a6d7cbe621c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.452787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a659d23dba42bd83007a6d7cbe621c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.453583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a659d23dba42bd83007a6d7cbe621c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.459897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1024/2026] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:01 2022] DELETE /identity/v3/users/08a659d23dba42bd83007a6d7cbe621c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:02.513338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1003/2027] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:02 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:02.517479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.518915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:02.595493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54333ba-0f1b-4837-87e0-ad267ed464c9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:02.601135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317bdb-1213-466e-b87c-653fbce019b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:02.601890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317bdb-1213-466e-b87c-653fbce019b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.602212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317bdb-1213-466e-b87c-653fbce019b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.602612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317bdb-1213-466e-b87c-653fbce019b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.603480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317bdb-1213-466e-b87c-653fbce019b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:02.605047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317bdb-1213-466e-b87c-653fbce019b3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:02.616933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1025/2028] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:02.621421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c8e8c-8c66-49ee-b265-2b33d9932516 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.639747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c8e8c-8c66-49ee-b265-2b33d9932516 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:02.644875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd361e-e896-4aef-b883-a4ec4a3b07a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:02.645484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd361e-e896-4aef-b883-a4ec4a3b07a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.645774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd361e-e896-4aef-b883-a4ec4a3b07a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.646052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd361e-e896-4aef-b883-a4ec4a3b07a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.646777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd361e-e896-4aef-b883-a4ec4a3b07a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:02.648560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd361e-e896-4aef-b883-a4ec4a3b07a3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:02.659604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1004/2029] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:02.664459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317bdb-1213-466e-b87c-653fbce019b3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.675184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317bdb-1213-466e-b87c-653fbce019b3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:02.681149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957659f-4c1d-463f-8bfc-bed2bb20462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:02.682050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957659f-4c1d-463f-8bfc-bed2bb20462a admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.682356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957659f-4c1d-463f-8bfc-bed2bb20462a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.682635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957659f-4c1d-463f-8bfc-bed2bb20462a admin admin] PATH_INFO: `/v3/projects/4adab3a8a3494a8aae527e5f56301446/users/455bd55f810f4126ac9f33b8d47d8ece/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.701131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957659f-4c1d-463f-8bfc-bed2bb20462a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4adab3a8a3494a8aae527e5f56301446, user_id=455bd55f810f4126ac9f33b8d47d8ece, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:02.703857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957659f-4c1d-463f-8bfc-bed2bb20462a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:02.813806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1026/2030] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:02 2022] PUT /identity/v3/projects/4adab3a8a3494a8aae527e5f56301446/users/455bd55f810f4126ac9f33b8d47d8ece/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:02.826198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0cfd7-e926-42b3-bda2-b0ba4a66549d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.826491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0cfd7-e926-42b3-bda2-b0ba4a66549d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.826843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0cfd7-e926-42b3-bda2-b0ba4a66549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.857013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-81a0cfd7-e926-42b3-bda2-b0ba4a66549d None None] MFA Rules not processed for user `455bd55f810f4126ac9f33b8d47d8ece`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:02.858251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-81a0cfd7-e926-42b3-bda2-b0ba4a66549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:02.933888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1005/2031] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:02.938454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957659f-4c1d-463f-8bfc-bed2bb20462a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.997353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0cfd7-e926-42b3-bda2-b0ba4a66549d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.999104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-81a0cfd7-e926-42b3-bda2-b0ba4a66549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:03.014555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957659f-4c1d-463f-8bfc-bed2bb20462a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.020927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5fc51-ff51-492e-a99b-b512b7639de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.021779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5fc51-ff51-492e-a99b-b512b7639de1 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.022212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5fc51-ff51-492e-a99b-b512b7639de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.022679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5fc51-ff51-492e-a99b-b512b7639de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.023742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5fc51-ff51-492e-a99b-b512b7639de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.026214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5fc51-ff51-492e-a99b-b512b7639de1 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.108545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0cfd7-e926-42b3-bda2-b0ba4a66549d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.115342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.118091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.118395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.118686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] PATH_INFO: `/v3/projects/4e6db77ed22f476699b326d46b754e11` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.121065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6db77ed22f476699b326d46b754e11)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.125070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.171254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1027/2032] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:02 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:03.177267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5fc51-ff51-492e-a99b-b512b7639de1 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.238659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6db77ed22f476699b326d46b754e11', 'request_id': 'req-34fa156c-b3ce-4341-9b9a-ba6900e221b3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.243968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5fc51-ff51-492e-a99b-b512b7639de1 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.245840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6db77ed22f476699b326d46b754e11', 'request_id': 'req-34fa156c-b3ce-4341-9b9a-ba6900e221b3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.252290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6db77ed22f476699b326d46b754e11', 'request_id': 'req-34fa156c-b3ce-4341-9b9a-ba6900e221b3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.302813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6569b75-a401-44cb-89b6-88010461dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.304097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6569b75-a401-44cb-89b6-88010461dcde admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.304379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6569b75-a401-44cb-89b6-88010461dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.304652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6569b75-a401-44cb-89b6-88010461dcde admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.305372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6569b75-a401-44cb-89b6-88010461dcde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.307275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6569b75-a401-44cb-89b6-88010461dcde admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.323528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] The token cache is being invalidate because project 4e6db77ed22f476699b326d46b754e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:03.323856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.324507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34fa156c-b3ce-4341-9b9a-ba6900e221b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.326113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1006/2033] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:02 2022] DELETE /identity/v3/projects/4e6db77ed22f476699b326d46b754e11 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:03.331063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151dbe-7a37-440d-ad80-422b5aad4c73 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.331348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151dbe-7a37-440d-ad80-422b5aad4c73 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.331684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151dbe-7a37-440d-ad80-422b5aad4c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.351173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-df151dbe-7a37-440d-ad80-422b5aad4c73 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:03.352399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-df151dbe-7a37-440d-ad80-422b5aad4c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:03.360557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1007/2034] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:03.368980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19929021-f4d4-4b05-a32a-aeb5562896a5 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.369519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19929021-f4d4-4b05-a32a-aeb5562896a5 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.370037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19929021-f4d4-4b05-a32a-aeb5562896a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.389715 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-19929021-f4d4-4b05-a32a-aeb5562896a5 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:03.391415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-19929021-f4d4-4b05-a32a-aeb5562896a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:03.401318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1028/2035] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:03 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:03.401506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1008/2036] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:03.402541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6569b75-a401-44cb-89b6-88010461dcde admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.404828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b6569b75-a401-44cb-89b6-88010461dcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:03.405131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19929021-f4d4-4b05-a32a-aeb5562896a5 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.415150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19929021-f4d4-4b05-a32a-aeb5562896a5 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.420140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7826f-29ef-41db-ba0c-44c6661cda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.420705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6569b75-a401-44cb-89b6-88010461dcde admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.420827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7826f-29ef-41db-ba0c-44c6661cda6b admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.421111 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7826f-29ef-41db-ba0c-44c6661cda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.421389 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7826f-29ef-41db-ba0c-44c6661cda6b admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.422130 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7826f-29ef-41db-ba0c-44c6661cda6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:06:03.422963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7826f-29ef-41db-ba0c-44c6661cda6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.424306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7826f-29ef-41db-ba0c-44c6661cda6b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.427669 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791f7e7-01e4-43df-be73-6890172b6b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.428056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f7e7-01e4-43df-be73-6890172b6b88 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.429207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f7e7-01e4-43df-be73-6890172b6b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.429438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f7e7-01e4-43df-be73-6890172b6b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.430177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791f7e7-01e4-43df-be73-6890172b6b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.431872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791f7e7-01e4-43df-be73-6890172b6b88 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.440329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1009/2037] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:06:03.443429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7826f-29ef-41db-ba0c-44c6661cda6b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.448992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1029/2038] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:03.448992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791f7e7-01e4-43df-be73-6890172b6b88 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.454287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7826f-29ef-41db-ba0c-44c6661cda6b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.457419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791f7e7-01e4-43df-be73-6890172b6b88 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.458853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcbf04-80a9-4170-9282-7eddda8bbf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.459532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcbf04-80a9-4170-9282-7eddda8bbf05 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.459851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcbf04-80a9-4170-9282-7eddda8bbf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.460125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcbf04-80a9-4170-9282-7eddda8bbf05 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.460808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcbf04-80a9-4170-9282-7eddda8bbf05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.462156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7bea8-1cc2-4339-9fd6-35ab89c1a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.462713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcbf04-80a9-4170-9282-7eddda8bbf05 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.463017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7bea8-1cc2-4339-9fd6-35ab89c1a06c admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.463295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7bea8-1cc2-4339-9fd6-35ab89c1a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.463595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7bea8-1cc2-4339-9fd6-35ab89c1a06c admin admin] PATH_INFO: `/v3/projects/4757dcd84942489a9693eb19338ba7e8/users/e67f4bc910954c959c98b537c7c98197/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.483689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7bea8-1cc2-4339-9fd6-35ab89c1a06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4757dcd84942489a9693eb19338ba7e8, user_id=e67f4bc910954c959c98b537c7c98197, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.486551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7bea8-1cc2-4339-9fd6-35ab89c1a06c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.565318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1030/2039] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:03 2022] PUT /identity/v3/projects/4757dcd84942489a9693eb19338ba7e8/users/e67f4bc910954c959c98b537c7c98197/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:03.566511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7bea8-1cc2-4339-9fd6-35ab89c1a06c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.567076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1010/2040] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:03 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:03.569910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcbf04-80a9-4170-9282-7eddda8bbf05 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.574528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-65d7bea8-1cc2-4339-9fd6-35ab89c1a06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:03.652686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcbf04-80a9-4170-9282-7eddda8bbf05 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.652934 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7bea8-1cc2-4339-9fd6-35ab89c1a06c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.657106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1671-7fec-4e69-9469-aba3d8fba029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.657382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.657788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1671-7fec-4e69-9469-aba3d8fba029 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.658105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1671-7fec-4e69-9469-aba3d8fba029 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.658603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.658743 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1671-7fec-4e69-9469-aba3d8fba029 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.658834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.658834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] PATH_INFO: `/v3/users/310b63d274564b55820dc798cf961519` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.659163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b1671-7fec-4e69-9469-aba3d8fba029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.660134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=310b63d274564b55820dc798cf961519)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.660913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b1671-7fec-4e69-9469-aba3d8fba029 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.662100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.674206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1011/2041] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:03.675494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1671-7fec-4e69-9469-aba3d8fba029 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.687847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1671-7fec-4e69-9469-aba3d8fba029 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.693274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befad7d0-bcc7-4313-a1d4-5c02b3a05403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.694700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befad7d0-bcc7-4313-a1d4-5c02b3a05403 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.695103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befad7d0-bcc7-4313-a1d4-5c02b3a05403 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.695861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befad7d0-bcc7-4313-a1d4-5c02b3a05403 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.696060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befad7d0-bcc7-4313-a1d4-5c02b3a05403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.698097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befad7d0-bcc7-4313-a1d4-5c02b3a05403 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.781164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1012/2042] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:03 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:03.781998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befad7d0-bcc7-4313-a1d4-5c02b3a05403 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.792184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befad7d0-bcc7-4313-a1d4-5c02b3a05403 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.799684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb354f-cb65-4957-913c-9f3358e17e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.800867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb354f-cb65-4957-913c-9f3358e17e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.800867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb354f-cb65-4957-913c-9f3358e17e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.801332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb354f-cb65-4957-913c-9f3358e17e7b admin admin] PATH_INFO: `/v3/projects/4757dcd84942489a9693eb19338ba7e8/users/e67f4bc910954c959c98b537c7c98197/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.806472 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb354f-cb65-4957-913c-9f3358e17e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4757dcd84942489a9693eb19338ba7e8, user_id=e67f4bc910954c959c98b537c7c98197, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.809232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb354f-cb65-4957-913c-9f3358e17e7b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.824318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1013/2043] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:03 2022] PUT /identity/v3/projects/4757dcd84942489a9693eb19338ba7e8/users/e67f4bc910954c959c98b537c7c98197/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:03.825046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb354f-cb65-4957-913c-9f3358e17e7b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.898746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb354f-cb65-4957-913c-9f3358e17e7b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.903696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2a3e2-382e-42a7-afce-a8ffc500e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.904364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2a3e2-382e-42a7-afce-a8ffc500e2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.904655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2a3e2-382e-42a7-afce-a8ffc500e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.904946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2a3e2-382e-42a7-afce-a8ffc500e2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.905695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2a3e2-382e-42a7-afce-a8ffc500e2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.907313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2a3e2-382e-42a7-afce-a8ffc500e2b5 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.917872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1014/2044] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:03.919255 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b1569-723a-447a-a3a2-0bba509776f8 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.919588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b1569-723a-447a-a3a2-0bba509776f8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.920402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b1569-723a-447a-a3a2-0bba509776f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.952572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310b63d274564b55820dc798cf961519'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.953177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-867b1569-723a-447a-a3a2-0bba509776f8 None None] MFA Rules not processed for user `e67f4bc910954c959c98b537c7c98197`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:03.954492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-867b1569-723a-447a-a3a2-0bba509776f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:04.010167 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:04.030242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1015/2045] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:04.031083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b1569-723a-447a-a3a2-0bba509776f8 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:04.039162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310b63d274564b55820dc798cf961519'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:04.041973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b1569-723a-447a-a3a2-0bba509776f8 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:04.047008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310b63d274564b55820dc798cf961519'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:04.050979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c30582-f321-42ac-8710-1482c50d6216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:04.050979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c30582-f321-42ac-8710-1482c50d6216 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:04.050979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c30582-f321-42ac-8710-1482c50d6216 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:04.050979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c30582-f321-42ac-8710-1482c50d6216 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:04.051286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c30582-f321-42ac-8710-1482c50d6216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:04.051286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c30582-f321-42ac-8710-1482c50d6216 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:04.060664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310b63d274564b55820dc798cf961519'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:04.061404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310b63d274564b55820dc798cf961519'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:04.062353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1016/2046] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:04.063206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c30582-f321-42ac-8710-1482c50d6216 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:04.065034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-96c30582-f321-42ac-8710-1482c50d6216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:04.071251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1031/2047] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:03 2022] DELETE /identity/v3/users/310b63d274564b55820dc798cf961519 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:04.075777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:04.075777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:04.128773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c30582-f321-42ac-8710-1482c50d6216 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:04.145368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6b8e6-78ad-4949-b056-20040abe9063 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:04.150783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d22f-e514-40a9-afb1-7396b174f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:04.151968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d22f-e514-40a9-afb1-7396b174f98a admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:04.152255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d22f-e514-40a9-afb1-7396b174f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:04.152535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d22f-e514-40a9-afb1-7396b174f98a admin admin] PATH_INFO: `/v3/projects/c5cb2cde51494cca9611524a999b5a85/users/f3808261725f477987bba552ebe7007f/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:04.170087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d22f-e514-40a9-afb1-7396b174f98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cb2cde51494cca9611524a999b5a85, user_id=f3808261725f477987bba552ebe7007f, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:04.172951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d22f-e514-40a9-afb1-7396b174f98a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:04.181517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:04.185719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51172f-d20f-4dbc-9503-b49ca3e39a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:04.186392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51172f-d20f-4dbc-9503-b49ca3e39a09 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:04.186683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51172f-d20f-4dbc-9503-b49ca3e39a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:04.186966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51172f-d20f-4dbc-9503-b49ca3e39a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:04.189040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2a51172f-d20f-4dbc-9503-b49ca3e39a09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:04.267398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51172f-d20f-4dbc-9503-b49ca3e39a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:04.269654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51172f-d20f-4dbc-9503-b49ca3e39a09 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:04.281449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1017/2048] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:04.283068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be4e2-d3f7-4059-a3d1-79a7cb435660 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:04.283368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be4e2-d3f7-4059-a3d1-79a7cb435660 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:04.283671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be4e2-d3f7-4059-a3d1-79a7cb435660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:04.295596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1032/2049] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:04 2022] PUT /identity/v3/projects/c5cb2cde51494cca9611524a999b5a85/users/f3808261725f477987bba552ebe7007f/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:04.302172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946178e8-989b-4262-bd19-0b590bd567e1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:04.302464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946178e8-989b-4262-bd19-0b590bd567e1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:04.302748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946178e8-989b-4262-bd19-0b590bd567e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:04.302855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d71be4e2-d3f7-4059-a3d1-79a7cb435660 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:04.304627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d71be4e2-d3f7-4059-a3d1-79a7cb435660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:04.339336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-946178e8-989b-4262-bd19-0b590bd567e1 None None] MFA Rules not processed for user `f3808261725f477987bba552ebe7007f`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:04.340921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-946178e8-989b-4262-bd19-0b590bd567e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:04.376210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1018/2050] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:04.386476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be4e2-d3f7-4059-a3d1-79a7cb435660 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:04.387950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d71be4e2-d3f7-4059-a3d1-79a7cb435660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:04.415236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1033/2051] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:04.432188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946178e8-989b-4262-bd19-0b590bd567e1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:04.446157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946178e8-989b-4262-bd19-0b590bd567e1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:04.452241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ea9e6-1a00-4316-b379-c65ea094b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:04.453027 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ea9e6-1a00-4316-b379-c65ea094b3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:04.453312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ea9e6-1a00-4316-b379-c65ea094b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:04.453593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ea9e6-1a00-4316-b379-c65ea094b3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:04.454295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ea9e6-1a00-4316-b379-c65ea094b3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:04.456284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ea9e6-1a00-4316-b379-c65ea094b3d9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:04.458332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be4e2-d3f7-4059-a3d1-79a7cb435660 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:04.462975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e31636-84d5-4070-b50e-64ff2cb19fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:04.463967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e31636-84d5-4070-b50e-64ff2cb19fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:04.464444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e31636-84d5-4070-b50e-64ff2cb19fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:04.464904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e31636-84d5-4070-b50e-64ff2cb19fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:04.478270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e31636-84d5-4070-b50e-64ff2cb19fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:04.479954 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e31636-84d5-4070-b50e-64ff2cb19fa1 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:04.490758 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1019/2052] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:06:05.211755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1034/2053] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:04 2022] POST /identity/v3/projects => generated 377 bytes in 780 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:05.215462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e31636-84d5-4070-b50e-64ff2cb19fa1 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.226575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e31636-84d5-4070-b50e-64ff2cb19fa1 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:05.309407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5de1c-407f-4b38-ab89-1bd944ce8613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:05.310121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5de1c-407f-4b38-ab89-1bd944ce8613 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.310436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5de1c-407f-4b38-ab89-1bd944ce8613 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.310737 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5de1c-407f-4b38-ab89-1bd944ce8613 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.311447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5de1c-407f-4b38-ab89-1bd944ce8613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:05.313455 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5de1c-407f-4b38-ab89-1bd944ce8613 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:05.438153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1020/2054] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:05 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:05.444382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ea9e6-1a00-4316-b379-c65ea094b3d9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.452785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ea9e6-1a00-4316-b379-c65ea094b3d9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:05.457857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188a333-08ba-4bef-9708-01e8a95f4b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:05.458525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188a333-08ba-4bef-9708-01e8a95f4b50 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.458990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188a333-08ba-4bef-9708-01e8a95f4b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.459273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188a333-08ba-4bef-9708-01e8a95f4b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.461683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188a333-08ba-4bef-9708-01e8a95f4b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:05.461845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188a333-08ba-4bef-9708-01e8a95f4b50 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:05.464971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5de1c-407f-4b38-ab89-1bd944ce8613 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.467138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b7c5de1c-407f-4b38-ab89-1bd944ce8613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:05.475626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1035/2055] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:05.484171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5de1c-407f-4b38-ab89-1bd944ce8613 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:05.486335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:05.487247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.487462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.487721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188a333-08ba-4bef-9708-01e8a95f4b50 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.487895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] PATH_INFO: `/v3/projects/f9e17a993c774c7ea1bc8736c73d0a80` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.489124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e17a993c774c7ea1bc8736c73d0a80)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:05.491969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:05.501231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188a333-08ba-4bef-9708-01e8a95f4b50 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:05.506300 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714082-31f4-4ae6-a950-e320e26913f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:05.507666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714082-31f4-4ae6-a950-e320e26913f2 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.507949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714082-31f4-4ae6-a950-e320e26913f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.508230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714082-31f4-4ae6-a950-e320e26913f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.508953 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96714082-31f4-4ae6-a950-e320e26913f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:05.510610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96714082-31f4-4ae6-a950-e320e26913f2 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:05.521727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1036/2056] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:05.525653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714082-31f4-4ae6-a950-e320e26913f2 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.536659 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714082-31f4-4ae6-a950-e320e26913f2 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:05.542134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a93504-c997-458c-b68c-4c81b94b6a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:05.543001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a93504-c997-458c-b68c-4c81b94b6a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.543313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a93504-c997-458c-b68c-4c81b94b6a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.543618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a93504-c997-458c-b68c-4c81b94b6a4b admin admin] PATH_INFO: `/v3/projects/03bbb31c7be84d0299ebd7523210a470/users/9a3061a07f044df39fa2b82604a45f68/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.562642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a93504-c997-458c-b68c-4c81b94b6a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bbb31c7be84d0299ebd7523210a470, user_id=9a3061a07f044df39fa2b82604a45f68, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:05.565884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a93504-c997-458c-b68c-4c81b94b6a4b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:05.649688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1037/2057] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:05 2022] PUT /identity/v3/projects/03bbb31c7be84d0299ebd7523210a470/users/9a3061a07f044df39fa2b82604a45f68/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:05.657056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e17a993c774c7ea1bc8736c73d0a80', 'request_id': 'req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:05.661513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dd2c0-9e65-4155-a781-01255396deb6 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.661804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dd2c0-9e65-4155-a781-01255396deb6 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.662083 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dd2c0-9e65-4155-a781-01255396deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.665023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e17a993c774c7ea1bc8736c73d0a80', 'request_id': 'req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:05.673155 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e17a993c774c7ea1bc8736c73d0a80', 'request_id': 'req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:05.695151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-583dd2c0-9e65-4155-a781-01255396deb6 None None] MFA Rules not processed for user `9a3061a07f044df39fa2b82604a45f68`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:05.695661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-583dd2c0-9e65-4155-a781-01255396deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:05.769882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1038/2058] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:05.781436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dd2c0-9e65-4155-a781-01255396deb6 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.833334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] The token cache is being invalidate because project f9e17a993c774c7ea1bc8736c73d0a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:05.833821 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:05.834962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8ddd9a2f-8cb9-4f25-a64b-58c7c4b407d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:05.837476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1021/2059] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:05 2022] DELETE /identity/v3/projects/f9e17a993c774c7ea1bc8736c73d0a80 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:05.844004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5222c-58c0-4b9e-8bf6-1a48b09a87ee None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.844545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5222c-58c0-4b9e-8bf6-1a48b09a87ee None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.844817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5222c-58c0-4b9e-8bf6-1a48b09a87ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.852636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dd2c0-9e65-4155-a781-01255396deb6 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:05.873002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393edc0-7adf-490f-911d-1b1fb7d8605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:05.873002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393edc0-7adf-490f-911d-1b1fb7d8605f admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.873002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393edc0-7adf-490f-911d-1b1fb7d8605f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.873002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393edc0-7adf-490f-911d-1b1fb7d8605f admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.873358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393edc0-7adf-490f-911d-1b1fb7d8605f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:05.873456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a9b5222c-58c0-4b9e-8bf6-1a48b09a87ee None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:05.873456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a9b5222c-58c0-4b9e-8bf6-1a48b09a87ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:05.873648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393edc0-7adf-490f-911d-1b1fb7d8605f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:05.879279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1022/2060] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:05.888290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d3a0f-606e-4b5e-8626-da3133fd1df9 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.888769 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d3a0f-606e-4b5e-8626-da3133fd1df9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.889108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d3a0f-606e-4b5e-8626-da3133fd1df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.911355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-bb7d3a0f-606e-4b5e-8626-da3133fd1df9 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:05.913253 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bb7d3a0f-606e-4b5e-8626-da3133fd1df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:05.923305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1023/2061] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:05.927784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d3a0f-606e-4b5e-8626-da3133fd1df9 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.937850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d3a0f-606e-4b5e-8626-da3133fd1df9 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:05.947024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529cc8b-f8e2-4c70-9384-62b6f35e794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:05.947024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529cc8b-f8e2-4c70-9384-62b6f35e794c admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.947024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529cc8b-f8e2-4c70-9384-62b6f35e794c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.947024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529cc8b-f8e2-4c70-9384-62b6f35e794c admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.947354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529cc8b-f8e2-4c70-9384-62b6f35e794c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:06:05.947354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529cc8b-f8e2-4c70-9384-62b6f35e794c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:05.948686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529cc8b-f8e2-4c70-9384-62b6f35e794c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:05.961949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1024/2062] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:06:05.966817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529cc8b-f8e2-4c70-9384-62b6f35e794c admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.977669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529cc8b-f8e2-4c70-9384-62b6f35e794c admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:05.982612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ae4f9-aa07-4bdf-a56b-4dc0d631e0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:05.983260 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ae4f9-aa07-4bdf-a56b-4dc0d631e0fd admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:05.983542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ae4f9-aa07-4bdf-a56b-4dc0d631e0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:05.983862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ae4f9-aa07-4bdf-a56b-4dc0d631e0fd admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:05.984707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1039/2063] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:05 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:05.984861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ae4f9-aa07-4bdf-a56b-4dc0d631e0fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:05.986774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ae4f9-aa07-4bdf-a56b-4dc0d631e0fd admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:05.988818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393edc0-7adf-490f-911d-1b1fb7d8605f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:05.990480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2393edc0-7adf-490f-911d-1b1fb7d8605f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:05.992102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:06.058606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393edc0-7adf-490f-911d-1b1fb7d8605f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.064012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821c7a9-e1a8-4038-b156-33948c36b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.064700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821c7a9-e1a8-4038-b156-33948c36b7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.064984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821c7a9-e1a8-4038-b156-33948c36b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.065262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821c7a9-e1a8-4038-b156-33948c36b7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.066056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821c7a9-e1a8-4038-b156-33948c36b7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.068073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821c7a9-e1a8-4038-b156-33948c36b7b8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.105182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1025/2064] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:05 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:06.109716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ae4f9-aa07-4bdf-a56b-4dc0d631e0fd admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.179884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ae4f9-aa07-4bdf-a56b-4dc0d631e0fd admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.184602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ef6e2-c1aa-43b9-ab64-b6cf7fcbe63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.185359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ef6e2-c1aa-43b9-ab64-b6cf7fcbe63c admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.185639 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ef6e2-c1aa-43b9-ab64-b6cf7fcbe63c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.185910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ef6e2-c1aa-43b9-ab64-b6cf7fcbe63c admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.186601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ef6e2-c1aa-43b9-ab64-b6cf7fcbe63c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.188580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ef6e2-c1aa-43b9-ab64-b6cf7fcbe63c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.194080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1040/2065] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:05 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:06.198147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821c7a9-e1a8-4038-b156-33948c36b7b8 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.212852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821c7a9-e1a8-4038-b156-33948c36b7b8 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.218029 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79e46-cb20-4e82-93ee-274e842827b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.218710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79e46-cb20-4e82-93ee-274e842827b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.219269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79e46-cb20-4e82-93ee-274e842827b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.219572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79e46-cb20-4e82-93ee-274e842827b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.221517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd79e46-cb20-4e82-93ee-274e842827b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.222179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd79e46-cb20-4e82-93ee-274e842827b0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.235285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1041/2066] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:06.239433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79e46-cb20-4e82-93ee-274e842827b0 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.249845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79e46-cb20-4e82-93ee-274e842827b0 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.260525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a229c99-4554-42e5-b8c8-a3544d6ee2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.261176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a229c99-4554-42e5-b8c8-a3544d6ee2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.261463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a229c99-4554-42e5-b8c8-a3544d6ee2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.261780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a229c99-4554-42e5-b8c8-a3544d6ee2ac admin admin] PATH_INFO: `/v3/projects/c2c9e32149c04df29489dc9ad5833279/users/15d4f4f5690e4e668fdafa040c2e04e7/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.284168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a229c99-4554-42e5-b8c8-a3544d6ee2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c9e32149c04df29489dc9ad5833279, user_id=15d4f4f5690e4e668fdafa040c2e04e7, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.288427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a229c99-4554-42e5-b8c8-a3544d6ee2ac admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.319475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1026/2067] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:06 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:06.319475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ef6e2-c1aa-43b9-ab64-b6cf7fcbe63c admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.319475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-669ef6e2-c1aa-43b9-ab64-b6cf7fcbe63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:06.331749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ef6e2-c1aa-43b9-ab64-b6cf7fcbe63c admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.337352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.338877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.339177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.339444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] PATH_INFO: `/v3/users/455bd55f810f4126ac9f33b8d47d8ece` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.340952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455bd55f810f4126ac9f33b8d47d8ece)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.343296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.375534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1042/2068] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:06 2022] PUT /identity/v3/projects/c2c9e32149c04df29489dc9ad5833279/users/15d4f4f5690e4e668fdafa040c2e04e7/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:06.378511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a229c99-4554-42e5-b8c8-a3544d6ee2ac admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.440282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a229c99-4554-42e5-b8c8-a3544d6ee2ac admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.445935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0fcb-cbbb-4259-a7cc-e7a700fdef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.446600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0fcb-cbbb-4259-a7cc-e7a700fdef5d admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.446880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0fcb-cbbb-4259-a7cc-e7a700fdef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.447156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0fcb-cbbb-4259-a7cc-e7a700fdef5d admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.447915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e0fcb-cbbb-4259-a7cc-e7a700fdef5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.449576 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e0fcb-cbbb-4259-a7cc-e7a700fdef5d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.460702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1043/2069] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:06.461572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0fcb-cbbb-4259-a7cc-e7a700fdef5d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.471929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0fcb-cbbb-4259-a7cc-e7a700fdef5d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.476801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6712e70-bc3e-4b5a-8b63-99e96344b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.484634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6712e70-bc3e-4b5a-8b63-99e96344b766 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.484634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6712e70-bc3e-4b5a-8b63-99e96344b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.484634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6712e70-bc3e-4b5a-8b63-99e96344b766 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.484634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6712e70-bc3e-4b5a-8b63-99e96344b766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.484634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6712e70-bc3e-4b5a-8b63-99e96344b766 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.493793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1044/2070] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:06.493793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6712e70-bc3e-4b5a-8b63-99e96344b766 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.495172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455bd55f810f4126ac9f33b8d47d8ece'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:06.501477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6712e70-bc3e-4b5a-8b63-99e96344b766 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.503647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455bd55f810f4126ac9f33b8d47d8ece'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:06.504366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455bd55f810f4126ac9f33b8d47d8ece'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:06.507299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90451f99-b371-4d76-a2a0-f280b9ccf5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.507466 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90451f99-b371-4d76-a2a0-f280b9ccf5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.507773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90451f99-b371-4d76-a2a0-f280b9ccf5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.508082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90451f99-b371-4d76-a2a0-f280b9ccf5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.508807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90451f99-b371-4d76-a2a0-f280b9ccf5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.510413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90451f99-b371-4d76-a2a0-f280b9ccf5b9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.518235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455bd55f810f4126ac9f33b8d47d8ece'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:06.518970 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0713cddc-5c52-412f-ba8a-c478b393c641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455bd55f810f4126ac9f33b8d47d8ece'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:06.522644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1045/2071] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:06.526706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90451f99-b371-4d76-a2a0-f280b9ccf5b9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.531282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-90451f99-b371-4d76-a2a0-f280b9ccf5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:06.542689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90451f99-b371-4d76-a2a0-f280b9ccf5b9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.547144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cb4aa-8f91-49cb-acc4-42e103ca5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.548078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cb4aa-8f91-49cb-acc4-42e103ca5acd admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.553654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cb4aa-8f91-49cb-acc4-42e103ca5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.553654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cb4aa-8f91-49cb-acc4-42e103ca5acd admin admin] PATH_INFO: `/v3/projects/c2c9e32149c04df29489dc9ad5833279/users/15d4f4f5690e4e668fdafa040c2e04e7/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.553654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cb4aa-8f91-49cb-acc4-42e103ca5acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c9e32149c04df29489dc9ad5833279, user_id=15d4f4f5690e4e668fdafa040c2e04e7, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.553654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cb4aa-8f91-49cb-acc4-42e103ca5acd admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.564323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1046/2072] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:06 2022] PUT /identity/v3/projects/c2c9e32149c04df29489dc9ad5833279/users/15d4f4f5690e4e668fdafa040c2e04e7/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:06.565301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cb4aa-8f91-49cb-acc4-42e103ca5acd admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.566940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-786cb4aa-8f91-49cb-acc4-42e103ca5acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:06.602813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1027/2073] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:06 2022] DELETE /identity/v3/users/455bd55f810f4126ac9f33b8d47d8ece => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:06.604242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec695d0-9b38-4f11-98fe-f585d63a2abb None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.604535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec695d0-9b38-4f11-98fe-f585d63a2abb None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.604816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec695d0-9b38-4f11-98fe-f585d63a2abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.633866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1ec695d0-9b38-4f11-98fe-f585d63a2abb None None] MFA Rules not processed for user `15d4f4f5690e4e668fdafa040c2e04e7`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:06.635051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1ec695d0-9b38-4f11-98fe-f585d63a2abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:06.637949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cb4aa-8f91-49cb-acc4-42e103ca5acd admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.698408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1d152-7b20-42ad-b0c4-6aa9f5cecddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.699343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d152-7b20-42ad-b0c4-6aa9f5cecddb admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.699680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d152-7b20-42ad-b0c4-6aa9f5cecddb admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.699958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d152-7b20-42ad-b0c4-6aa9f5cecddb admin admin] PATH_INFO: `/v3/projects/e7b9e0c64c1d44e89ea374080d534042/users/d22992f2b4b043dd9e44ef4cab3d7628/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.708928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1028/2074] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:06.710519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefac4d-55b6-4f58-a8d9-6c3457478544 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.710810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefac4d-55b6-4f58-a8d9-6c3457478544 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.711092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefac4d-55b6-4f58-a8d9-6c3457478544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.720123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1d152-7b20-42ad-b0c4-6aa9f5cecddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b9e0c64c1d44e89ea374080d534042, user_id=d22992f2b4b043dd9e44ef4cab3d7628, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.723057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1d152-7b20-42ad-b0c4-6aa9f5cecddb admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.733561 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-deefac4d-55b6-4f58-a8d9-6c3457478544 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:06.734780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-deefac4d-55b6-4f58-a8d9-6c3457478544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:06.743384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1029/2075] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:06.744479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefac4d-55b6-4f58-a8d9-6c3457478544 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.746038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-deefac4d-55b6-4f58-a8d9-6c3457478544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:06.813931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefac4d-55b6-4f58-a8d9-6c3457478544 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.815340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1047/2076] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:06 2022] PUT /identity/v3/projects/e7b9e0c64c1d44e89ea374080d534042/users/d22992f2b4b043dd9e44ef4cab3d7628/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:06.826860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1d152-7b20-42ad-b0c4-6aa9f5cecddb admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:06.828661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ebb1d152-7b20-42ad-b0c4-6aa9f5cecddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:06.840506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:06.869217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68254fd4-2d59-47fe-b275-3f6c3ee8778e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.869809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68254fd4-2d59-47fe-b275-3f6c3ee8778e service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.870068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68254fd4-2d59-47fe-b275-3f6c3ee8778e service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.870426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68254fd4-2d59-47fe-b275-3f6c3ee8778e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.895904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1d152-7b20-42ad-b0c4-6aa9f5cecddb admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:06.899743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97576a8-df05-4f33-923f-f2a64028fc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:06.900392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97576a8-df05-4f33-923f-f2a64028fc5f service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.900674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97576a8-df05-4f33-923f-f2a64028fc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.900949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97576a8-df05-4f33-923f-f2a64028fc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.937419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68254fd4-2d59-47fe-b275-3f6c3ee8778e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.938982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68254fd4-2d59-47fe-b275-3f6c3ee8778e service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.950103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1030/2077] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:06.951611 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eb5c1-2d89-412b-af23-2a816eae695a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:06.951982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eb5c1-2d89-412b-af23-2a816eae695a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:06.952336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eb5c1-2d89-412b-af23-2a816eae695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:06.967267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97576a8-df05-4f33-923f-f2a64028fc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:06.968802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97576a8-df05-4f33-923f-f2a64028fc5f service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:06.979537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1048/2078] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:06.982736 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-2f5eb5c1-2d89-412b-af23-2a816eae695a None None] MFA Rules not processed for user `d22992f2b4b043dd9e44ef4cab3d7628`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:06.984189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2f5eb5c1-2d89-412b-af23-2a816eae695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:07.062939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1031/2079] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:07.074029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:07.074442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97576a8-df05-4f33-923f-f2a64028fc5f service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:07.076414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a97576a8-df05-4f33-923f-f2a64028fc5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:07.076765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eb5c1-2d89-412b-af23-2a816eae695a None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:07.086945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eb5c1-2d89-412b-af23-2a816eae695a None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:07.091176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172880ee-4c45-4bde-98a1-c8152ac188c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:07.092324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172880ee-4c45-4bde-98a1-c8152ac188c4 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:07.092542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97576a8-df05-4f33-923f-f2a64028fc5f service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:07.092794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172880ee-4c45-4bde-98a1-c8152ac188c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:07.093193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172880ee-4c45-4bde-98a1-c8152ac188c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:07.095414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-172880ee-4c45-4bde-98a1-c8152ac188c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:07.096453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66160e04-d895-4a8e-8402-7c5cf4f4c767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:07.097221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66160e04-d895-4a8e-8402-7c5cf4f4c767 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:07.097579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66160e04-d895-4a8e-8402-7c5cf4f4c767 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:07.097930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66160e04-d895-4a8e-8402-7c5cf4f4c767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:07.107714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66160e04-d895-4a8e-8402-7c5cf4f4c767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:07.109234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66160e04-d895-4a8e-8402-7c5cf4f4c767 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:07.119211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1049/2080] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:06:07.159821 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172880ee-4c45-4bde-98a1-c8152ac188c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:07.161412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172880ee-4c45-4bde-98a1-c8152ac188c4 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:07.171461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1032/2081] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:06:07.541218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66160e04-d895-4a8e-8402-7c5cf4f4c767 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:07.542790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-66160e04-d895-4a8e-8402-7c5cf4f4c767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:07.557375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66160e04-d895-4a8e-8402-7c5cf4f4c767 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:07.562745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:07.563703 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:07.567089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:07.567089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] PATH_INFO: `/v3/projects/4adab3a8a3494a8aae527e5f56301446` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:07.567089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4adab3a8a3494a8aae527e5f56301446)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:07.567677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:07.727515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4adab3a8a3494a8aae527e5f56301446', 'request_id': 'req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:07.734144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4adab3a8a3494a8aae527e5f56301446', 'request_id': 'req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:07.739750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4adab3a8a3494a8aae527e5f56301446', 'request_id': 'req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:07.896190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:07.902964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] The token cache is being invalidate because project 4adab3a8a3494a8aae527e5f56301446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:07.903256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:07.903910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:07.905847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1050/2082] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:07 2022] DELETE /identity/v3/projects/4adab3a8a3494a8aae527e5f56301446 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:07.909847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172880ee-4c45-4bde-98a1-c8152ac188c4 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:07.920990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172880ee-4c45-4bde-98a1-c8152ac188c4 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:07.977079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:07.977868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:07.978148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:07.978420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] PATH_INFO: `/v3/users/e67f4bc910954c959c98b537c7c98197` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:07.979609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67f4bc910954c959c98b537c7c98197)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:07.981522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:08.217364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:08.230825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67f4bc910954c959c98b537c7c98197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:08.238515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67f4bc910954c959c98b537c7c98197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:08.239375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67f4bc910954c959c98b537c7c98197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:08.252979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67f4bc910954c959c98b537c7c98197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:08.253719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a81e1356-05f7-4711-b5ee-f846a7a9144e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67f4bc910954c959c98b537c7c98197'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:08.365383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1033/2083] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:07 2022] DELETE /identity/v3/users/e67f4bc910954c959c98b537c7c98197 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:08.862554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:08.864198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:08.876438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:08.883196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40965d8-be7a-4e35-98e8-aa9bac6bfba8 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:08.941813 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:08.942219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:08.942501 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:08.942774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] PATH_INFO: `/v3/projects/4757dcd84942489a9693eb19338ba7e8` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:08.943993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4757dcd84942489a9693eb19338ba7e8)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:08.945896 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:09.096314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4757dcd84942489a9693eb19338ba7e8', 'request_id': 'req-af38656c-2512-4624-ad6a-5eacc07a3b33'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:09.103070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4757dcd84942489a9693eb19338ba7e8', 'request_id': 'req-af38656c-2512-4624-ad6a-5eacc07a3b33'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:09.108541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4757dcd84942489a9693eb19338ba7e8', 'request_id': 'req-af38656c-2512-4624-ad6a-5eacc07a3b33'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:09.203228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] The token cache is being invalidate because project 4757dcd84942489a9693eb19338ba7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:09.203554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:09.204245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-af38656c-2512-4624-ad6a-5eacc07a3b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:09.205834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1051/2084] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:08 2022] DELETE /identity/v3/projects/4757dcd84942489a9693eb19338ba7e8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:09.212280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af8c2-45d4-4a2c-acfb-6656583e5437 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.212766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af8c2-45d4-4a2c-acfb-6656583e5437 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.212860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af8c2-45d4-4a2c-acfb-6656583e5437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.231699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-879af8c2-45d4-4a2c-acfb-6656583e5437 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:09.232891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-879af8c2-45d4-4a2c-acfb-6656583e5437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:09.295072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1034/2085] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:09.303323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c81ef-eede-4eff-b606-af9f8d514130 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.303499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c359-1082-4aba-8bd9-0ba622d2c84b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.303639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c81ef-eede-4eff-b606-af9f8d514130 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.303749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c359-1082-4aba-8bd9-0ba622d2c84b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.303921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c81ef-eede-4eff-b606-af9f8d514130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.304044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c359-1082-4aba-8bd9-0ba622d2c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.322569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-ad2c81ef-eede-4eff-b606-af9f8d514130 None None] MFA Rules not processed for user `d22992f2b4b043dd9e44ef4cab3d7628`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:09.336403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ad2c81ef-eede-4eff-b606-af9f8d514130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:09.336768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0a05c359-1082-4aba-8bd9-0ba622d2c84b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:09.336768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0a05c359-1082-4aba-8bd9-0ba622d2c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:09.336768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1035/2086] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:09.340887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05c359-1082-4aba-8bd9-0ba622d2c84b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:09.350610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05c359-1082-4aba-8bd9-0ba622d2c84b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:09.355392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ae72-e82b-4f15-a868-ee66e9cab786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:09.356101 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ae72-e82b-4f15-a868-ee66e9cab786 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.356390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ae72-e82b-4f15-a868-ee66e9cab786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.356671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ae72-e82b-4f15-a868-ee66e9cab786 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.357403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ae72-e82b-4f15-a868-ee66e9cab786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:06:09.357717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ae72-e82b-4f15-a868-ee66e9cab786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:09.359639 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ae72-e82b-4f15-a868-ee66e9cab786 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:09.371647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1036/2087] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:06:09.377575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ae72-e82b-4f15-a868-ee66e9cab786 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:09.383685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1052/2088] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:09.388025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ae72-e82b-4f15-a868-ee66e9cab786 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:09.392360 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:09.399309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d35a88-28bf-408a-b3e3-3ba04508a825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:09.399309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d35a88-28bf-408a-b3e3-3ba04508a825 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.399309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d35a88-28bf-408a-b3e3-3ba04508a825 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.399309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d35a88-28bf-408a-b3e3-3ba04508a825 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.400193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d35a88-28bf-408a-b3e3-3ba04508a825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:09.400193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d35a88-28bf-408a-b3e3-3ba04508a825 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:09.500039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1037/2089] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:09 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:09.501224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c81ef-eede-4eff-b606-af9f8d514130 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:09.512529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c81ef-eede-4eff-b606-af9f8d514130 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:09.577615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce113-b8b0-45f0-b66d-9052caaa37b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:09.578311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce113-b8b0-45f0-b66d-9052caaa37b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.578591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce113-b8b0-45f0-b66d-9052caaa37b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.579009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce113-b8b0-45f0-b66d-9052caaa37b7 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.579747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ce113-b8b0-45f0-b66d-9052caaa37b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:09.581688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ce113-b8b0-45f0-b66d-9052caaa37b7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:09.633316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:09.847388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1053/2090] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:09 2022] POST /identity/v3/users => generated 289 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:09.848751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d35a88-28bf-408a-b3e3-3ba04508a825 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:09.860142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d35a88-28bf-408a-b3e3-3ba04508a825 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:09.864821 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4543d-d9f3-4476-9773-56b9ad777195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:09.866070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4543d-d9f3-4476-9773-56b9ad777195 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.866365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4543d-d9f3-4476-9773-56b9ad777195 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.867071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4543d-d9f3-4476-9773-56b9ad777195 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.867365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4543d-d9f3-4476-9773-56b9ad777195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:09.869034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4543d-d9f3-4476-9773-56b9ad777195 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:09.880109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1038/2091] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:09.884706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce113-b8b0-45f0-b66d-9052caaa37b7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:09.895529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce113-b8b0-45f0-b66d-9052caaa37b7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:09.900817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5703d60-ad2f-457d-bf9a-c5e5002040ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:09.901408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703d60-ad2f-457d-bf9a-c5e5002040ba admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.901695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703d60-ad2f-457d-bf9a-c5e5002040ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.901973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703d60-ad2f-457d-bf9a-c5e5002040ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.902707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5703d60-ad2f-457d-bf9a-c5e5002040ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:09.904369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5703d60-ad2f-457d-bf9a-c5e5002040ba admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:09.918172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1054/2092] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:09.920618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4543d-d9f3-4476-9773-56b9ad777195 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:09.931207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4543d-d9f3-4476-9773-56b9ad777195 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:09.935785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f88fed-40c3-4de3-a059-241e8d361b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:09.946590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f88fed-40c3-4de3-a059-241e8d361b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:09.946590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f88fed-40c3-4de3-a059-241e8d361b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:09.946590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f88fed-40c3-4de3-a059-241e8d361b7e admin admin] PATH_INFO: `/v3/projects/a0b530cd7ef148b99f9d01e01857a1ff/users/43d361b9e5d042aa980ded96db464bf7/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:09.954344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f88fed-40c3-4de3-a059-241e8d361b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b530cd7ef148b99f9d01e01857a1ff, user_id=43d361b9e5d042aa980ded96db464bf7, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:09.957054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f88fed-40c3-4de3-a059-241e8d361b7e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:10.062257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1039/2093] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:09 2022] PUT /identity/v3/projects/a0b530cd7ef148b99f9d01e01857a1ff/users/43d361b9e5d042aa980ded96db464bf7/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:10.078434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6b4f-dede-424b-8906-64cabbbf0fae None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:10.078723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6b4f-dede-424b-8906-64cabbbf0fae None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:10.079000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6b4f-dede-424b-8906-64cabbbf0fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:10.107190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-694c6b4f-dede-424b-8906-64cabbbf0fae None None] MFA Rules not processed for user `43d361b9e5d042aa980ded96db464bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:10.108446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-694c6b4f-dede-424b-8906-64cabbbf0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:10.173200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1055/2094] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:10.184842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f88fed-40c3-4de3-a059-241e8d361b7e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:10.186610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b3f88fed-40c3-4de3-a059-241e8d361b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:10.265107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f88fed-40c3-4de3-a059-241e8d361b7e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:10.268891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb0cb6-724b-4e2e-be5e-e808799f4453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:10.269494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb0cb6-724b-4e2e-be5e-e808799f4453 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:10.269780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb0cb6-724b-4e2e-be5e-e808799f4453 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:10.270054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb0cb6-724b-4e2e-be5e-e808799f4453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:10.279009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb0cb6-724b-4e2e-be5e-e808799f4453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:10.280535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb0cb6-724b-4e2e-be5e-e808799f4453 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:10.290198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1040/2095] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:11.137019 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:11.464279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:12.827440 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:13.071158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6b4f-dede-424b-8906-64cabbbf0fae None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:13.072670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-694c6b4f-dede-424b-8906-64cabbbf0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:13.140700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6b4f-dede-424b-8906-64cabbbf0fae None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:13.145143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:13.146023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:13.159968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:13.159968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] PATH_INFO: `/v3/users/f3808261725f477987bba552ebe7007f` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:13.159968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3808261725f477987bba552ebe7007f)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:13.159968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:13.436126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3808261725f477987bba552ebe7007f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:13.558113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3808261725f477987bba552ebe7007f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:13.565927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3808261725f477987bba552ebe7007f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:13.578720 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3808261725f477987bba552ebe7007f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:13.579415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3808261725f477987bba552ebe7007f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:13.585331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1056/2096] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:13 2022] DELETE /identity/v3/users/f3808261725f477987bba552ebe7007f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:13.589986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561551f-7cd4-4d31-b826-5cbf309f0730 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:13.590279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561551f-7cd4-4d31-b826-5cbf309f0730 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:13.590560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561551f-7cd4-4d31-b826-5cbf309f0730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:13.608826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a561551f-7cd4-4d31-b826-5cbf309f0730 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:13.610032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a561551f-7cd4-4d31-b826-5cbf309f0730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:13.675433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1041/2097] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:13.685990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:13.687435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:13.759948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41936a-ba3d-4e96-9b8d-99e99abf9e6c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:13.764143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d62e2-a038-4d31-82ad-817804a36508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:13.765006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d62e2-a038-4d31-82ad-817804a36508 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:13.765469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d62e2-a038-4d31-82ad-817804a36508 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:13.765919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d62e2-a038-4d31-82ad-817804a36508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:13.777152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d62e2-a038-4d31-82ad-817804a36508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:13.778886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d62e2-a038-4d31-82ad-817804a36508 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:13.790327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1057/2098] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:14.567834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561551f-7cd4-4d31-b826-5cbf309f0730 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:14.569844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a561551f-7cd4-4d31-b826-5cbf309f0730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:14.583502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561551f-7cd4-4d31-b826-5cbf309f0730 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:14.588851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:14.589886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:14.590245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:14.590435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] PATH_INFO: `/v3/projects/c5cb2cde51494cca9611524a999b5a85` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:14.593126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5cb2cde51494cca9611524a999b5a85)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:14.594645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:14.734575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5cb2cde51494cca9611524a999b5a85', 'request_id': 'req-207b907a-df1c-4c46-8b44-6ab8737687aa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:14.741596 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5cb2cde51494cca9611524a999b5a85', 'request_id': 'req-207b907a-df1c-4c46-8b44-6ab8737687aa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:14.747128 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5cb2cde51494cca9611524a999b5a85', 'request_id': 'req-207b907a-df1c-4c46-8b44-6ab8737687aa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:14.753133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:14.868584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] The token cache is being invalidate because project c5cb2cde51494cca9611524a999b5a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:14.869098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:14.869915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:14.872126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1042/2099] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:14 2022] DELETE /identity/v3/projects/c5cb2cde51494cca9611524a999b5a85 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:14.877229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d62e2-a038-4d31-82ad-817804a36508 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:14.890515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d62e2-a038-4d31-82ad-817804a36508 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:14.956665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:14.957547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:14.957880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:14.958163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] PATH_INFO: `/v3/users/9a3061a07f044df39fa2b82604a45f68` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:14.959952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3061a07f044df39fa2b82604a45f68)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:14.962234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:15.286498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3061a07f044df39fa2b82604a45f68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:15.376791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3061a07f044df39fa2b82604a45f68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:15.391807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3061a07f044df39fa2b82604a45f68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:15.407710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3061a07f044df39fa2b82604a45f68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:15.408837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3061a07f044df39fa2b82604a45f68'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:15.416414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1058/2100] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:14 2022] DELETE /identity/v3/users/9a3061a07f044df39fa2b82604a45f68 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:15.953143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:15.955034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:15.970264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b907a-df1c-4c46-8b44-6ab8737687aa admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:16.038869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:16.039833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:16.040118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:16.044996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] PATH_INFO: `/v3/projects/03bbb31c7be84d0299ebd7523210a470` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:16.044996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bbb31c7be84d0299ebd7523210a470)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:16.044996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:16.169658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bbb31c7be84d0299ebd7523210a470', 'request_id': 'req-282ea31a-4290-4819-a222-afd1c709e52a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.176558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bbb31c7be84d0299ebd7523210a470', 'request_id': 'req-282ea31a-4290-4819-a222-afd1c709e52a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.182581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bbb31c7be84d0299ebd7523210a470', 'request_id': 'req-282ea31a-4290-4819-a222-afd1c709e52a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.347405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] The token cache is being invalidate because project 03bbb31c7be84d0299ebd7523210a470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:16.347854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.348522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.350600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1043/2101] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:15 2022] DELETE /identity/v3/projects/03bbb31c7be84d0299ebd7523210a470 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:16.354358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:16.355951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:16.369128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc84e9c-21f3-46f9-b4d9-fcb1930f2a84 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:16.426945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:16.430873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:16.431784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:16.432074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:16.432374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] PATH_INFO: `/v3/users/15d4f4f5690e4e668fdafa040c2e04e7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:16.433596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d4f4f5690e4e668fdafa040c2e04e7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:16.435675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:16.642073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d4f4f5690e4e668fdafa040c2e04e7'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.733990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d4f4f5690e4e668fdafa040c2e04e7'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.743274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d4f4f5690e4e668fdafa040c2e04e7'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.757284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d4f4f5690e4e668fdafa040c2e04e7'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.758039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c8d23543-8bcc-4118-945c-2108bfb01504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d4f4f5690e4e668fdafa040c2e04e7'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:16.764521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1059/2102] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:16 2022] DELETE /identity/v3/users/15d4f4f5690e4e668fdafa040c2e04e7 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:17.468658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:17.471238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:17.484508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ea31a-4290-4819-a222-afd1c709e52a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:17.561981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:17.562859 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:17.563143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:17.563418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] PATH_INFO: `/v3/projects/c2c9e32149c04df29489dc9ad5833279` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:17.564648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c9e32149c04df29489dc9ad5833279)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:17.566585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:17.776890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c9e32149c04df29489dc9ad5833279', 'request_id': 'req-36d210a8-622e-44ac-8122-0f26f69c37c3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:17.783430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c9e32149c04df29489dc9ad5833279', 'request_id': 'req-36d210a8-622e-44ac-8122-0f26f69c37c3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:17.789778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c9e32149c04df29489dc9ad5833279', 'request_id': 'req-36d210a8-622e-44ac-8122-0f26f69c37c3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:17.907454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:17.912845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] The token cache is being invalidate because project c2c9e32149c04df29489dc9ad5833279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:17.913084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:17.913807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-36d210a8-622e-44ac-8122-0f26f69c37c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:17.915419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1044/2103] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:17 2022] DELETE /identity/v3/projects/c2c9e32149c04df29489dc9ad5833279 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:19.003817 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:19.547134 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:21.192804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:21.490573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:22.722701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:24.083916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:24.414794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:25.072463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:25.294895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:26.741388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:27.323785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:27.433995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2150c-9b55-412c-9306-c6e63411dee9 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:27.434402 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2150c-9b55-412c-9306-c6e63411dee9 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:27.434751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2150c-9b55-412c-9306-c6e63411dee9 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:27.436333 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1060/2104] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 17:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:06:27.451792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b3dc3-143a-4c70-87a5-4029ea0b27a6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:27.452169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b3dc3-143a-4c70-87a5-4029ea0b27a6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:27.452521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b3dc3-143a-4c70-87a5-4029ea0b27a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:27.524192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ff8b3dc3-143a-4c70-87a5-4029ea0b27a6 None None] MFA Rules not processed for user `bae184afff284dcaa228859902e92191`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:27.525453 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ff8b3dc3-143a-4c70-87a5-4029ea0b27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:27.601482 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1045/2105] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 17:06:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:27.612985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2150c-9b55-412c-9306-c6e63411dee9 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:27.614773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-06b2150c-9b55-412c-9306-c6e63411dee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:27.632963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2150c-9b55-412c-9306-c6e63411dee9 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:27.647548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa296e6f-c8ad-481f-af53-2530a9099fb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:27.648471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa296e6f-c8ad-481f-af53-2530a9099fb8 service placement] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:27.648918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa296e6f-c8ad-481f-af53-2530a9099fb8 service placement] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:27.649389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa296e6f-c8ad-481f-af53-2530a9099fb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:27.659379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa296e6f-c8ad-481f-af53-2530a9099fb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:27.661098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa296e6f-c8ad-481f-af53-2530a9099fb8 service placement] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:27.676181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1061/2106] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:28.565927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b3dc3-143a-4c70-87a5-4029ea0b27a6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:28.568075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ff8b3dc3-143a-4c70-87a5-4029ea0b27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:28.648554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:28.656717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b3dc3-143a-4c70-87a5-4029ea0b27a6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:28.664403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:28.665397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:28.665700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:28.665977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] PATH_INFO: `/v3/users/8358ea0b1ec94a67a38eb88643dd1d1c` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:28.667176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8358ea0b1ec94a67a38eb88643dd1d1c)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:28.669371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:28.850308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:28.937341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8358ea0b1ec94a67a38eb88643dd1d1c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:28.944795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8358ea0b1ec94a67a38eb88643dd1d1c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:28.945704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8358ea0b1ec94a67a38eb88643dd1d1c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:28.964209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8358ea0b1ec94a67a38eb88643dd1d1c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:28.965013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8358ea0b1ec94a67a38eb88643dd1d1c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:29.059064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1046/2107] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:28 2022] DELETE /identity/v3/users/8358ea0b1ec94a67a38eb88643dd1d1c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:29.376074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa296e6f-c8ad-481f-af53-2530a9099fb8 service placement] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:29.387987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa296e6f-c8ad-481f-af53-2530a9099fb8 service placement] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:29.450811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:29.451703 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:29.451988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:29.452323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] PATH_INFO: `/v3/projects/c1466f1e10a64bb2901cacaefedcf41a` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:29.453679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1466f1e10a64bb2901cacaefedcf41a)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:29.455672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:29.604650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1466f1e10a64bb2901cacaefedcf41a', 'request_id': 'req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:29.610691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1466f1e10a64bb2901cacaefedcf41a', 'request_id': 'req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:29.617170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1466f1e10a64bb2901cacaefedcf41a', 'request_id': 'req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:29.707101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] The token cache is being invalidate because project c1466f1e10a64bb2901cacaefedcf41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:29.707399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:29.708125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:29.709791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1062/2108] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:29 2022] DELETE /identity/v3/projects/c1466f1e10a64bb2901cacaefedcf41a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:29.714172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:29.715691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:29.732951 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56f664-5545-450d-a3fe-3a868e9e60cf admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:29.797742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:29.798652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:29.798941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:29.799215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] PATH_INFO: `/v3/users/415c23ce52ce466fa81bc74b143353e1` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:29.800532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415c23ce52ce466fa81bc74b143353e1)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:29.803542 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:30.057161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415c23ce52ce466fa81bc74b143353e1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.064547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415c23ce52ce466fa81bc74b143353e1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.065279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415c23ce52ce466fa81bc74b143353e1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.077442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415c23ce52ce466fa81bc74b143353e1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.078122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415c23ce52ce466fa81bc74b143353e1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.236610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1047/2109] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:29 2022] DELETE /identity/v3/users/415c23ce52ce466fa81bc74b143353e1 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:30.502584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:30.504299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:30.508025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:30.518814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ca4b0-be99-48c1-9ef2-70a8d00760e6 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:30.582908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:30.583846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.584128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.584439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] PATH_INFO: `/v3/projects/dcbdcb4c4a5f4037be64c1e6e4c13eca` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.585718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbdcb4c4a5f4037be64c1e6e4c13eca)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:30.588321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:30.708279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbdcb4c4a5f4037be64c1e6e4c13eca', 'request_id': 'req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.714723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbdcb4c4a5f4037be64c1e6e4c13eca', 'request_id': 'req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.720962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbdcb4c4a5f4037be64c1e6e4c13eca', 'request_id': 'req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.730431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:30.732061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:30.745525 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9581-abe4-4b8c-a401-a69f03e0abd9 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:30.801110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:30.802798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.803140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.803255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] The token cache is being invalidate because project dcbdcb4c4a5f4037be64c1e6e4c13eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:30.803352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] PATH_INFO: `/v3/users/43d361b9e5d042aa980ded96db464bf7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.803467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.804140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ce6bb636-f045-49d6-8bda-1a0fa3ca5393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:30.804773 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d361b9e5d042aa980ded96db464bf7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:30.805913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1063/2110] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:30 2022] DELETE /identity/v3/projects/dcbdcb4c4a5f4037be64c1e6e4c13eca => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:30.806839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:30.815849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cdd27-719f-45b1-b1cf-68702f7479b2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.815849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cdd27-719f-45b1-b1cf-68702f7479b2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.815849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cdd27-719f-45b1-b1cf-68702f7479b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.831764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b18cdd27-719f-45b1-b1cf-68702f7479b2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:30.832961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b18cdd27-719f-45b1-b1cf-68702f7479b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:30.840999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1064/2111] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:30.851986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78b4a6-9a07-4da1-b554-60155c8ce705 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.852277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78b4a6-9a07-4da1-b554-60155c8ce705 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.852564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78b4a6-9a07-4da1-b554-60155c8ce705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.872110 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:30.873766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5e78b4a6-9a07-4da1-b554-60155c8ce705 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:30.875008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5e78b4a6-9a07-4da1-b554-60155c8ce705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:30.883870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1065/2112] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:30.887904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78b4a6-9a07-4da1-b554-60155c8ce705 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:30.897263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78b4a6-9a07-4da1-b554-60155c8ce705 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:30.902026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1a66e-8517-447c-b613-97aa37d8f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:30.902682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a66e-8517-447c-b613-97aa37d8f1bf admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.902962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a66e-8517-447c-b613-97aa37d8f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.903235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a66e-8517-447c-b613-97aa37d8f1bf admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.904008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1a66e-8517-447c-b613-97aa37d8f1bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:06:30.904332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1a66e-8517-447c-b613-97aa37d8f1bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:30.905954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1a66e-8517-447c-b613-97aa37d8f1bf admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:30.921862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1066/2113] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:06:30.927002 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1a66e-8517-447c-b613-97aa37d8f1bf admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:30.929946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:30.939054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1a66e-8517-447c-b613-97aa37d8f1bf admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:30.943845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14ad8-a3ae-43d3-89d5-afe9ba430163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:30.944501 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14ad8-a3ae-43d3-89d5-afe9ba430163 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:30.944787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14ad8-a3ae-43d3-89d5-afe9ba430163 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:30.945598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14ad8-a3ae-43d3-89d5-afe9ba430163 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:30.946291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14ad8-a3ae-43d3-89d5-afe9ba430163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:30.948275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14ad8-a3ae-43d3-89d5-afe9ba430163 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:31.059723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1067/2114] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:30 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:31.060705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d361b9e5d042aa980ded96db464bf7'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:31.062308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14ad8-a3ae-43d3-89d5-afe9ba430163 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:31.069650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d361b9e5d042aa980ded96db464bf7'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:31.070503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d361b9e5d042aa980ded96db464bf7'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:31.084706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d361b9e5d042aa980ded96db464bf7'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:31.085478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-67342846-e8e5-40b7-856f-b3898ff6e647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d361b9e5d042aa980ded96db464bf7'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:31.136148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14ad8-a3ae-43d3-89d5-afe9ba430163 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:31.141161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09878772-e42e-4268-b9f3-0c424bf415da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:31.141848 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09878772-e42e-4268-b9f3-0c424bf415da admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.142128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09878772-e42e-4268-b9f3-0c424bf415da admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.142403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09878772-e42e-4268-b9f3-0c424bf415da admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.143140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09878772-e42e-4268-b9f3-0c424bf415da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:31.145203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09878772-e42e-4268-b9f3-0c424bf415da admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:31.214506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1048/2115] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:30 2022] DELETE /identity/v3/users/43d361b9e5d042aa980ded96db464bf7 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:31.219257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce801-1292-45f4-b886-0d0482b8cfe2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.219548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce801-1292-45f4-b886-0d0482b8cfe2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.219861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce801-1292-45f4-b886-0d0482b8cfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.250047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c14ce801-1292-45f4-b886-0d0482b8cfe2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:31.251332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c14ce801-1292-45f4-b886-0d0482b8cfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:31.295752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1068/2116] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:31 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:31.299819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09878772-e42e-4268-b9f3-0c424bf415da admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:31.301498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-09878772-e42e-4268-b9f3-0c424bf415da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:31.314294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09878772-e42e-4268-b9f3-0c424bf415da admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:31.317178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1049/2117] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:31.320302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cff01-b627-484d-ad2f-cb20f51ac381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:31.320966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cff01-b627-484d-ad2f-cb20f51ac381 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.321247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cff01-b627-484d-ad2f-cb20f51ac381 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.321521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cff01-b627-484d-ad2f-cb20f51ac381 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.322243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cff01-b627-484d-ad2f-cb20f51ac381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:31.323867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cff01-b627-484d-ad2f-cb20f51ac381 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:31.327414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ce801-1292-45f4-b886-0d0482b8cfe2 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:31.328848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c14ce801-1292-45f4-b886-0d0482b8cfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:31.335391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1069/2118] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:31.342130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cff01-b627-484d-ad2f-cb20f51ac381 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:31.353283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cff01-b627-484d-ad2f-cb20f51ac381 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:31.358498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe271bbd-15fc-4f41-be6d-5eb454203eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:31.359238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe271bbd-15fc-4f41-be6d-5eb454203eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.359523 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe271bbd-15fc-4f41-be6d-5eb454203eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.359860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe271bbd-15fc-4f41-be6d-5eb454203eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.360589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe271bbd-15fc-4f41-be6d-5eb454203eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:31.362194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe271bbd-15fc-4f41-be6d-5eb454203eb7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:31.373824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1070/2119] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:31.377860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe271bbd-15fc-4f41-be6d-5eb454203eb7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:31.387805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe271bbd-15fc-4f41-be6d-5eb454203eb7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:31.388785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ce801-1292-45f4-b886-0d0482b8cfe2 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:31.392423 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad08e3-b75c-4993-90f1-71d7e12579d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:31.392687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78c351-137a-4f99-b872-15df38352d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:31.393246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad08e3-b75c-4993-90f1-71d7e12579d7 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.393534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad08e3-b75c-4993-90f1-71d7e12579d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.393661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78c351-137a-4f99-b872-15df38352d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.393825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad08e3-b75c-4993-90f1-71d7e12579d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.393955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78c351-137a-4f99-b872-15df38352d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.394111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78c351-137a-4f99-b872-15df38352d07 admin admin] PATH_INFO: `/v3/projects/09eb9b2d0b2e4eae94391bc92ee3963d/users/f69f019d5f0a43969faed76145792ac4/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.404194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad08e3-b75c-4993-90f1-71d7e12579d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:31.405643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad08e3-b75c-4993-90f1-71d7e12579d7 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:31.413808 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78c351-137a-4f99-b872-15df38352d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09eb9b2d0b2e4eae94391bc92ee3963d, user_id=f69f019d5f0a43969faed76145792ac4, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:31.416479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78c351-137a-4f99-b872-15df38352d07 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:31.416602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1050/2120] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:06:31.417933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311702-aea0-40f7-9ee8-f662e291fc51 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.418281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311702-aea0-40f7-9ee8-f662e291fc51 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.418558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311702-aea0-40f7-9ee8-f662e291fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.468257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-51311702-aea0-40f7-9ee8-f662e291fc51 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:31.469467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-51311702-aea0-40f7-9ee8-f662e291fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:31.498195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1071/2121] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:31 2022] PUT /identity/v3/projects/09eb9b2d0b2e4eae94391bc92ee3963d/users/f69f019d5f0a43969faed76145792ac4/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:31.508607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643108a6-770f-4d2c-8e57-c5d3ae8e54c2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.509732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643108a6-770f-4d2c-8e57-c5d3ae8e54c2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.510026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643108a6-770f-4d2c-8e57-c5d3ae8e54c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.518607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:31.538865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-643108a6-770f-4d2c-8e57-c5d3ae8e54c2 None None] MFA Rules not processed for user `f69f019d5f0a43969faed76145792ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:31.540122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-643108a6-770f-4d2c-8e57-c5d3ae8e54c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:31.546898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1051/2122] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:06:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:31.595065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51311702-aea0-40f7-9ee8-f662e291fc51 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:31.597139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-51311702-aea0-40f7-9ee8-f662e291fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:31.620959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1072/2123] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:31.629298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643108a6-770f-4d2c-8e57-c5d3ae8e54c2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:31.631428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-643108a6-770f-4d2c-8e57-c5d3ae8e54c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:31.694961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643108a6-770f-4d2c-8e57-c5d3ae8e54c2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:31.699861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847edb8-2924-4c15-80e2-4f79c2774b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:31.700517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847edb8-2924-4c15-80e2-4f79c2774b3d service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.700801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847edb8-2924-4c15-80e2-4f79c2774b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.701077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847edb8-2924-4c15-80e2-4f79c2774b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.711004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847edb8-2924-4c15-80e2-4f79c2774b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:31.712211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51311702-aea0-40f7-9ee8-f662e291fc51 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:31.712876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847edb8-2924-4c15-80e2-4f79c2774b3d service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:31.723584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1073/2124] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:06:31.781577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be1fec-a224-4a18-9925-153a41ecdc97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:31.782230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be1fec-a224-4a18-9925-153a41ecdc97 service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.782519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be1fec-a224-4a18-9925-153a41ecdc97 service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.782780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be1fec-a224-4a18-9925-153a41ecdc97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.839154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be1fec-a224-4a18-9925-153a41ecdc97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:31.840810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be1fec-a224-4a18-9925-153a41ecdc97 service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:31.849885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1052/2125] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:06:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 17:06:31.882698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847edb8-2924-4c15-80e2-4f79c2774b3d service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:31.882698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9847edb8-2924-4c15-80e2-4f79c2774b3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:31.951954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847edb8-2924-4c15-80e2-4f79c2774b3d service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:31.956861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:31.957722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:31.958009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:31.958287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] PATH_INFO: `/v3/projects/a0b530cd7ef148b99f9d01e01857a1ff` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:31.959525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b530cd7ef148b99f9d01e01857a1ff)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:31.961518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:32.043939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:32.164210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b530cd7ef148b99f9d01e01857a1ff', 'request_id': 'req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:32.170770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b530cd7ef148b99f9d01e01857a1ff', 'request_id': 'req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:32.176814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b530cd7ef148b99f9d01e01857a1ff', 'request_id': 'req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:32.266602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] The token cache is being invalidate because project a0b530cd7ef148b99f9d01e01857a1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:32.269831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:32.269831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-1a7a97c7-1d9e-44df-a779-3783c4dbe80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:32.269831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1074/2126] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:31 2022] DELETE /identity/v3/projects/a0b530cd7ef148b99f9d01e01857a1ff => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:32.274522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3e9a5-1d16-4e44-a041-628c2a808d4c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:32.274808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3e9a5-1d16-4e44-a041-628c2a808d4c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:32.275083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3e9a5-1d16-4e44-a041-628c2a808d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:32.306753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8ed3e9a5-1d16-4e44-a041-628c2a808d4c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:32.308145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8ed3e9a5-1d16-4e44-a041-628c2a808d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:32.386227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1053/2127] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:32.388182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd31708-25e7-48d7-80d1-3e98ec1aba33 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:32.388470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd31708-25e7-48d7-80d1-3e98ec1aba33 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:32.388749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd31708-25e7-48d7-80d1-3e98ec1aba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:32.407890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5bd31708-25e7-48d7-80d1-3e98ec1aba33 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:32.412221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5bd31708-25e7-48d7-80d1-3e98ec1aba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:32.417476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1075/2128] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:32.421822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3e9a5-1d16-4e44-a041-628c2a808d4c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:32.432635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3e9a5-1d16-4e44-a041-628c2a808d4c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:32.437496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23d2cd-d051-4a16-a5fa-276b026cdc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:32.438149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23d2cd-d051-4a16-a5fa-276b026cdc2b admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:32.438429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23d2cd-d051-4a16-a5fa-276b026cdc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:32.438860 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23d2cd-d051-4a16-a5fa-276b026cdc2b admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:32.439776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23d2cd-d051-4a16-a5fa-276b026cdc2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:06:32.440090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23d2cd-d051-4a16-a5fa-276b026cdc2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:32.441944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23d2cd-d051-4a16-a5fa-276b026cdc2b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:32.458004 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1054/2129] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:06:32.459190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd31708-25e7-48d7-80d1-3e98ec1aba33 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:32.472597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd31708-25e7-48d7-80d1-3e98ec1aba33 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:32.481239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569de57b-d1ba-4feb-a47a-21390f2aec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:32.481239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569de57b-d1ba-4feb-a47a-21390f2aec3c admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:32.481239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569de57b-d1ba-4feb-a47a-21390f2aec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:32.481239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569de57b-d1ba-4feb-a47a-21390f2aec3c admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:32.481751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569de57b-d1ba-4feb-a47a-21390f2aec3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:32.481751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569de57b-d1ba-4feb-a47a-21390f2aec3c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:32.575925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1076/2130] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:32 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:32.578319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23d2cd-d051-4a16-a5fa-276b026cdc2b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:32.591278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23d2cd-d051-4a16-a5fa-276b026cdc2b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:32.658441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ceff-36da-405d-a5db-535227547f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:32.659235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ceff-36da-405d-a5db-535227547f30 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:32.659493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ceff-36da-405d-a5db-535227547f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:32.659802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ceff-36da-405d-a5db-535227547f30 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:32.660507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ceff-36da-405d-a5db-535227547f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:32.662971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ceff-36da-405d-a5db-535227547f30 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:32.772411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1055/2131] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:32 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:32.784973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569de57b-d1ba-4feb-a47a-21390f2aec3c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:32.795768 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569de57b-d1ba-4feb-a47a-21390f2aec3c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:32.800259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46ec94-aa79-49b1-b24e-60df506ce653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:32.800856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46ec94-aa79-49b1-b24e-60df506ce653 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:32.801138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46ec94-aa79-49b1-b24e-60df506ce653 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:32.801626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46ec94-aa79-49b1-b24e-60df506ce653 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:32.802376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46ec94-aa79-49b1-b24e-60df506ce653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:32.804015 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46ec94-aa79-49b1-b24e-60df506ce653 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:32.805714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:32.817398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1077/2132] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:32.825465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ceff-36da-405d-a5db-535227547f30 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:32.835793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ceff-36da-405d-a5db-535227547f30 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:32.840366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d49a31-2714-4180-b66b-4aa185afc94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:32.841008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d49a31-2714-4180-b66b-4aa185afc94a admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:32.841287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d49a31-2714-4180-b66b-4aa185afc94a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:32.841621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d49a31-2714-4180-b66b-4aa185afc94a admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:32.842858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d49a31-2714-4180-b66b-4aa185afc94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:32.844510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d49a31-2714-4180-b66b-4aa185afc94a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:32.855588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1056/2133] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:32.860676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46ec94-aa79-49b1-b24e-60df506ce653 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:32.871701 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46ec94-aa79-49b1-b24e-60df506ce653 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:32.876564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8712cd-cfef-4968-ac3c-c732d1882322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:32.880121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8712cd-cfef-4968-ac3c-c732d1882322 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:32.880121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8712cd-cfef-4968-ac3c-c732d1882322 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:32.880121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8712cd-cfef-4968-ac3c-c732d1882322 admin admin] PATH_INFO: `/v3/projects/41e96a709a06474c95233d864c1ff139/users/1fb0244aad5e4e73a43f04681ed6860b/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:32.893801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8712cd-cfef-4968-ac3c-c732d1882322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e96a709a06474c95233d864c1ff139, user_id=1fb0244aad5e4e73a43f04681ed6860b, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:32.897144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8712cd-cfef-4968-ac3c-c732d1882322 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:32.944358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a1bc-0fb2-4790-9cb1-b71fd3f812ee None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:32.944658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a1bc-0fb2-4790-9cb1-b71fd3f812ee None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:32.944937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a1bc-0fb2-4790-9cb1-b71fd3f812ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:32.963400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-4f74a1bc-0fb2-4790-9cb1-b71fd3f812ee None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:32.964626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4f74a1bc-0fb2-4790-9cb1-b71fd3f812ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:33.001499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1078/2134] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:32 2022] PUT /identity/v3/projects/41e96a709a06474c95233d864c1ff139/users/1fb0244aad5e4e73a43f04681ed6860b/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:33.008798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a9571-c714-4548-a914-e24a9fc30d18 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:33.009589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a9571-c714-4548-a914-e24a9fc30d18 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:33.010204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a9571-c714-4548-a914-e24a9fc30d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:33.031548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1057/2135] 10.222.0.93 () {58 vars in 967 bytes} [Thu May 26 17:06:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:33.033857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5a8a9571-c714-4548-a914-e24a9fc30d18 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:33.035115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5a8a9571-c714-4548-a914-e24a9fc30d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:33.044857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74a1bc-0fb2-4790-9cb1-b71fd3f812ee None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:33.046208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4f74a1bc-0fb2-4790-9cb1-b71fd3f812ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:33.100265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1079/2136] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:33.109674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a9571-c714-4548-a914-e24a9fc30d18 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:33.111310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5a8a9571-c714-4548-a914-e24a9fc30d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:33.118907 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74a1bc-0fb2-4790-9cb1-b71fd3f812ee None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:33.172858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a9571-c714-4548-a914-e24a9fc30d18 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:33.176527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8787c-e0c1-4ab2-824b-d46e96bb35cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:33.177173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8787c-e0c1-4ab2-824b-d46e96bb35cc service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:33.177480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8787c-e0c1-4ab2-824b-d46e96bb35cc service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:33.177758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8787c-e0c1-4ab2-824b-d46e96bb35cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:33.183673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9507-ca91-424a-94f6-918246a10e4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:33.184863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9507-ca91-424a-94f6-918246a10e4a service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:33.184863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9507-ca91-424a-94f6-918246a10e4a service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:33.185056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9507-ca91-424a-94f6-918246a10e4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:33.187092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8787c-e0c1-4ab2-824b-d46e96bb35cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:33.188812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8787c-e0c1-4ab2-824b-d46e96bb35cc service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:33.198924 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1080/2137] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:06:33.245996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d9507-ca91-424a-94f6-918246a10e4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:33.252377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d9507-ca91-424a-94f6-918246a10e4a service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:33.258995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1058/2138] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:06:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 17:06:33.341408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:34.100933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e37f7c-7555-44cd-9f34-c3f7d0520cba None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:34.101538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e37f7c-7555-44cd-9f34-c3f7d0520cba None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:34.101538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e37f7c-7555-44cd-9f34-c3f7d0520cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:34.107069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:34.120529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-26e37f7c-7555-44cd-9f34-c3f7d0520cba None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:34.121736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-26e37f7c-7555-44cd-9f34-c3f7d0520cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:34.129122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1081/2139] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:06:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:34.141749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9507-ca91-424a-94f6-918246a10e4a service swift] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:34.152934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9507-ca91-424a-94f6-918246a10e4a service swift] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:34.159060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08ea3d-8281-4d72-9771-d7890884a495 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:34.159767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ea3d-8281-4d72-9771-d7890884a495 service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:34.160056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ea3d-8281-4d72-9771-d7890884a495 service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:34.160508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ea3d-8281-4d72-9771-d7890884a495 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:34.169405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08ea3d-8281-4d72-9771-d7890884a495 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:34.171058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08ea3d-8281-4d72-9771-d7890884a495 service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:34.185396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1059/2140] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:06:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:06:34.608533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:34.655520 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:34.947839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6ef20-26e4-4e9c-8fd3-0dede829988e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:34.948279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6ef20-26e4-4e9c-8fd3-0dede829988e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:34.948624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6ef20-26e4-4e9c-8fd3-0dede829988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:34.978010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-23d6ef20-26e4-4e9c-8fd3-0dede829988e None None] MFA Rules not processed for user `1fb0244aad5e4e73a43f04681ed6860b`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:34.979228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-23d6ef20-26e4-4e9c-8fd3-0dede829988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:35.080176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1082/2141] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:35.083042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022fa5-e551-436c-974d-3f48ee8fff06 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:35.083330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022fa5-e551-436c-974d-3f48ee8fff06 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:35.086936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022fa5-e551-436c-974d-3f48ee8fff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:35.104006 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a9022fa5-e551-436c-974d-3f48ee8fff06 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:35.105226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a9022fa5-e551-436c-974d-3f48ee8fff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:35.113060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1060/2142] 10.222.0.93 () {58 vars in 967 bytes} [Thu May 26 17:06:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:35.126028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6ef20-26e4-4e9c-8fd3-0dede829988e None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:35.138241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6ef20-26e4-4e9c-8fd3-0dede829988e None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:35.143471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572212f-5093-4ddf-92e1-a5b3a4553408 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:35.144139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572212f-5093-4ddf-92e1-a5b3a4553408 service swift] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:35.144416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572212f-5093-4ddf-92e1-a5b3a4553408 service swift] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:35.144690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572212f-5093-4ddf-92e1-a5b3a4553408 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:35.156086 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572212f-5093-4ddf-92e1-a5b3a4553408 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:35.157672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572212f-5093-4ddf-92e1-a5b3a4553408 service swift] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:35.167138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1083/2143] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:06:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:06:35.205651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9022fa5-e551-436c-974d-3f48ee8fff06 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:35.207106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a9022fa5-e551-436c-974d-3f48ee8fff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:35.262379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9022fa5-e551-436c-974d-3f48ee8fff06 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:35.266853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3395e-294b-4333-bfb8-523f81643f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:35.267497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3395e-294b-4333-bfb8-523f81643f39 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:35.276953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3395e-294b-4333-bfb8-523f81643f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:35.276953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3395e-294b-4333-bfb8-523f81643f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:35.277146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3395e-294b-4333-bfb8-523f81643f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:35.278499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3395e-294b-4333-bfb8-523f81643f39 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:35.287892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1061/2144] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:36.883114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:37.420647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:37.573636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572212f-5093-4ddf-92e1-a5b3a4553408 service swift] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:37.575261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c572212f-5093-4ddf-92e1-a5b3a4553408 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:37.592596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572212f-5093-4ddf-92e1-a5b3a4553408 service swift] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:37.602076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:37.602076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:37.602076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:37.602076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] PATH_INFO: `/v3/users/f69f019d5f0a43969faed76145792ac4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:37.602653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69f019d5f0a43969faed76145792ac4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:37.604626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:37.857365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69f019d5f0a43969faed76145792ac4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:37.934458 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69f019d5f0a43969faed76145792ac4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:37.942217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69f019d5f0a43969faed76145792ac4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:37.954579 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69f019d5f0a43969faed76145792ac4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:37.955248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69f019d5f0a43969faed76145792ac4'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:37.961690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1084/2145] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:37 2022] DELETE /identity/v3/users/f69f019d5f0a43969faed76145792ac4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:37.966672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32183994-7714-40b8-82eb-0d2c3418a8c6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:37.967291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32183994-7714-40b8-82eb-0d2c3418a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:37.967732 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32183994-7714-40b8-82eb-0d2c3418a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:37.985941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-32183994-7714-40b8-82eb-0d2c3418a8c6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:37.988363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-32183994-7714-40b8-82eb-0d2c3418a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:38.056765 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1062/2146] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:38.068409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:38.069990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:38.093908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038998d8-018d-4c94-a25d-13304b9f3579 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:38.094306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038998d8-018d-4c94-a25d-13304b9f3579 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:38.094767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038998d8-018d-4c94-a25d-13304b9f3579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:38.112739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-038998d8-018d-4c94-a25d-13304b9f3579 None None] MFA Rules not processed for user `1fb0244aad5e4e73a43f04681ed6860b`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:38.113933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-038998d8-018d-4c94-a25d-13304b9f3579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:38.144427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4b79a-cc73-4c5b-85f8-5ad447b3f04f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:38.150292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a104-9085-4405-9733-ec0583499fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:38.150937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a104-9085-4405-9733-ec0583499fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:38.151386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a104-9085-4405-9733-ec0583499fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:38.151854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a104-9085-4405-9733-ec0583499fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:38.162556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a104-9085-4405-9733-ec0583499fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:38.164061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a104-9085-4405-9733-ec0583499fa2 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:38.174734 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1085/2147] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:38.175330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1063/2148] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:38.724612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:38.765755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038998d8-018d-4c94-a25d-13304b9f3579 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:38.767776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-038998d8-018d-4c94-a25d-13304b9f3579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:38.792289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038998d8-018d-4c94-a25d-13304b9f3579 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:38.798061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:38.799348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:38.799663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:38.800081 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] PATH_INFO: `/v3/projects/09eb9b2d0b2e4eae94391bc92ee3963d` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:38.804824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09eb9b2d0b2e4eae94391bc92ee3963d)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:38.805969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:38.964382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09eb9b2d0b2e4eae94391bc92ee3963d', 'request_id': 'req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:38.971139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09eb9b2d0b2e4eae94391bc92ee3963d', 'request_id': 'req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:38.977520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09eb9b2d0b2e4eae94391bc92ee3963d', 'request_id': 'req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:39.066480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:39.106758 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] The token cache is being invalidate because project 09eb9b2d0b2e4eae94391bc92ee3963d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:39.113770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:39.113770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:39.113770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1064/2149] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:38 2022] DELETE /identity/v3/projects/09eb9b2d0b2e4eae94391bc92ee3963d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:39.115216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ea7eb-218b-46bf-9950-aa4d6a1bf466 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.115512 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ea7eb-218b-46bf-9950-aa4d6a1bf466 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.115822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ea7eb-218b-46bf-9950-aa4d6a1bf466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.132011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:39.136629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:39.140089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-fd2ea7eb-218b-46bf-9950-aa4d6a1bf466 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:39.146376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-fd2ea7eb-218b-46bf-9950-aa4d6a1bf466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:39.228109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b58ea-7357-4d9d-a46e-ebe0d48dbe80 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:39.233711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:39.234736 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.235298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.235546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] PATH_INFO: `/v3/users/d22992f2b4b043dd9e44ef4cab3d7628` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.236921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1086/2150] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:39.237251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22992f2b4b043dd9e44ef4cab3d7628)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:39.239410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:39.244668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ce454-0c06-410b-b674-98ef037d18a3 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.249212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ce454-0c06-410b-b674-98ef037d18a3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.249212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ce454-0c06-410b-b674-98ef037d18a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.264938 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-6f4ce454-0c06-410b-b674-98ef037d18a3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:39.266407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6f4ce454-0c06-410b-b674-98ef037d18a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:39.275773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1087/2151] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:39.280041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ce454-0c06-410b-b674-98ef037d18a3 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:39.297706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ce454-0c06-410b-b674-98ef037d18a3 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:39.305190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b9602-fc79-42ce-8714-4937a5a5311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:39.305868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b9602-fc79-42ce-8714-4937a5a5311a admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.306157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b9602-fc79-42ce-8714-4937a5a5311a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.306488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b9602-fc79-42ce-8714-4937a5a5311a admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.307173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b9602-fc79-42ce-8714-4937a5a5311a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:06:39.307483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b9602-fc79-42ce-8714-4937a5a5311a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:39.309158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b9602-fc79-42ce-8714-4937a5a5311a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:39.329990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1088/2152] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:06:39.340894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b9602-fc79-42ce-8714-4937a5a5311a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:39.351311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b9602-fc79-42ce-8714-4937a5a5311a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:39.361074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59741f-ee15-42a4-940a-f7bfd85c3d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:39.361074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59741f-ee15-42a4-940a-f7bfd85c3d18 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.361074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59741f-ee15-42a4-940a-f7bfd85c3d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.361074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59741f-ee15-42a4-940a-f7bfd85c3d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.361491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59741f-ee15-42a4-940a-f7bfd85c3d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:39.361780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59741f-ee15-42a4-940a-f7bfd85c3d18 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:39.479087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1089/2153] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:39 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:39.480407 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59741f-ee15-42a4-940a-f7bfd85c3d18 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:39.488328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22992f2b4b043dd9e44ef4cab3d7628'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:39.496624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22992f2b4b043dd9e44ef4cab3d7628'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:39.497977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22992f2b4b043dd9e44ef4cab3d7628'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:39.515039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22992f2b4b043dd9e44ef4cab3d7628'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:39.515837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ecaa24c8-39b6-413e-95c9-6038beb1268d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22992f2b4b043dd9e44ef4cab3d7628'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:39.555163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59741f-ee15-42a4-940a-f7bfd85c3d18 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:39.562369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc0c77-2144-4d20-acc1-017992871d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:39.563057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc0c77-2144-4d20-acc1-017992871d0e admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.563523 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc0c77-2144-4d20-acc1-017992871d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.563850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc0c77-2144-4d20-acc1-017992871d0e admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.565087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc0c77-2144-4d20-acc1-017992871d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:39.566766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc0c77-2144-4d20-acc1-017992871d0e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:39.619047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1065/2154] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:39 2022] DELETE /identity/v3/users/d22992f2b4b043dd9e44ef4cab3d7628 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:39.623459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262fa84-6f3a-45d6-bfbb-9e571acd7f9f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.623779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262fa84-6f3a-45d6-bfbb-9e571acd7f9f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.624056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262fa84-6f3a-45d6-bfbb-9e571acd7f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.642911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-d262fa84-6f3a-45d6-bfbb-9e571acd7f9f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:39.644338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d262fa84-6f3a-45d6-bfbb-9e571acd7f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:39.724248 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1066/2155] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:39.734031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262fa84-6f3a-45d6-bfbb-9e571acd7f9f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:39.735460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d262fa84-6f3a-45d6-bfbb-9e571acd7f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:39.758795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1090/2156] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:39 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:39.769298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc0c77-2144-4d20-acc1-017992871d0e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:39.771248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-94cc0c77-2144-4d20-acc1-017992871d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:39.783824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc0c77-2144-4d20-acc1-017992871d0e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:39.789800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741098ee-e2ae-4be1-a5e1-8bc5c7c6beab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:39.790684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741098ee-e2ae-4be1-a5e1-8bc5c7c6beab admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.790982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741098ee-e2ae-4be1-a5e1-8bc5c7c6beab admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.791385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741098ee-e2ae-4be1-a5e1-8bc5c7c6beab admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.792298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741098ee-e2ae-4be1-a5e1-8bc5c7c6beab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:39.794016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741098ee-e2ae-4be1-a5e1-8bc5c7c6beab admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:39.795319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262fa84-6f3a-45d6-bfbb-9e571acd7f9f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:39.805233 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806ecdb-dab8-4cc7-b5b6-188513f158bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:39.811474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806ecdb-dab8-4cc7-b5b6-188513f158bf service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.811474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806ecdb-dab8-4cc7-b5b6-188513f158bf service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.811474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806ecdb-dab8-4cc7-b5b6-188513f158bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.813504 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1091/2157] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:39.819282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741098ee-e2ae-4be1-a5e1-8bc5c7c6beab admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:39.824636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806ecdb-dab8-4cc7-b5b6-188513f158bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:39.826113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806ecdb-dab8-4cc7-b5b6-188513f158bf service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:39.831601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741098ee-e2ae-4be1-a5e1-8bc5c7c6beab admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:39.836340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef17cf-e1cc-4200-bb7e-9184db31cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:39.836999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef17cf-e1cc-4200-bb7e-9184db31cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.837286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef17cf-e1cc-4200-bb7e-9184db31cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.837561 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef17cf-e1cc-4200-bb7e-9184db31cd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.838337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1067/2158] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:06:39.838468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef17cf-e1cc-4200-bb7e-9184db31cd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:39.839976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef17cf-e1cc-4200-bb7e-9184db31cd54 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:39.851338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1092/2159] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:39.856363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806ecdb-dab8-4cc7-b5b6-188513f158bf service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:39.867653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806ecdb-dab8-4cc7-b5b6-188513f158bf service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:39.884048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d09531-a783-4b13-b21b-10a32023239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:39.884048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d09531-a783-4b13-b21b-10a32023239e admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:39.884048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d09531-a783-4b13-b21b-10a32023239e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:39.884048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d09531-a783-4b13-b21b-10a32023239e admin admin] PATH_INFO: `/v3/projects/2056a72bcd9e4f348cd87f90b05e837d/users/c58a89f9c1ad435d9b74317b7b5aaf1a/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:39.900709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d09531-a783-4b13-b21b-10a32023239e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2056a72bcd9e4f348cd87f90b05e837d, user_id=c58a89f9c1ad435d9b74317b7b5aaf1a, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:39.903460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d09531-a783-4b13-b21b-10a32023239e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:40.045580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1068/2160] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:39 2022] PUT /identity/v3/projects/2056a72bcd9e4f348cd87f90b05e837d/users/c58a89f9c1ad435d9b74317b7b5aaf1a/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:40.057217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f88b4b-c2dc-466e-9b58-5092211a63fe None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.057510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f88b4b-c2dc-466e-9b58-5092211a63fe None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.057794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f88b4b-c2dc-466e-9b58-5092211a63fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.086499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-39f88b4b-c2dc-466e-9b58-5092211a63fe None None] MFA Rules not processed for user `c58a89f9c1ad435d9b74317b7b5aaf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:40.087738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-39f88b4b-c2dc-466e-9b58-5092211a63fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:40.157042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1093/2161] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:40.161277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d09531-a783-4b13-b21b-10a32023239e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:40.194248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f88b4b-c2dc-466e-9b58-5092211a63fe None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:40.195795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-39f88b4b-c2dc-466e-9b58-5092211a63fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:40.242916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d09531-a783-4b13-b21b-10a32023239e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:40.254610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaef76-f19f-4b5a-b979-2e5e0e124245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:40.254610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaef76-f19f-4b5a-b979-2e5e0e124245 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.254610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaef76-f19f-4b5a-b979-2e5e0e124245 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.254610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaef76-f19f-4b5a-b979-2e5e0e124245 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.255080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaef76-f19f-4b5a-b979-2e5e0e124245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:40.257199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaef76-f19f-4b5a-b979-2e5e0e124245 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:40.279792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f88b4b-c2dc-466e-9b58-5092211a63fe None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:40.285034 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:40.285998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.286313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.286626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] PATH_INFO: `/v3/projects/e7b9e0c64c1d44e89ea374080d534042` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.287907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b9e0c64c1d44e89ea374080d534042)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:40.289831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:40.451886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1069/2162] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:40 2022] POST /identity/v3/projects => generated 385 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:40.453435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaef76-f19f-4b5a-b979-2e5e0e124245 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:40.503408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b9e0c64c1d44e89ea374080d534042', 'request_id': 'req-83c0a1ba-050d-4f11-ba67-48a1a412c301'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:40.538491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b9e0c64c1d44e89ea374080d534042', 'request_id': 'req-83c0a1ba-050d-4f11-ba67-48a1a412c301'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:40.545195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b9e0c64c1d44e89ea374080d534042', 'request_id': 'req-83c0a1ba-050d-4f11-ba67-48a1a412c301'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:40.564802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaef76-f19f-4b5a-b979-2e5e0e124245 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:40.586268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:40.640596 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327c99-a352-4cc3-a83f-c1ed4965f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:40.641296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327c99-a352-4cc3-a83f-c1ed4965f3fa admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.641576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327c99-a352-4cc3-a83f-c1ed4965f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.641848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327c99-a352-4cc3-a83f-c1ed4965f3fa admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.642544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d327c99-a352-4cc3-a83f-c1ed4965f3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:40.644530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d327c99-a352-4cc3-a83f-c1ed4965f3fa admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:40.761041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] The token cache is being invalidate because project e7b9e0c64c1d44e89ea374080d534042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:40.762797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:40.765186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-83c0a1ba-050d-4f11-ba67-48a1a412c301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:40.768675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1094/2163] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:40 2022] DELETE /identity/v3/projects/e7b9e0c64c1d44e89ea374080d534042 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:40.778850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efebb65-eb94-4e80-9871-e86ec9f8e105 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.779242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efebb65-eb94-4e80-9871-e86ec9f8e105 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.779778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efebb65-eb94-4e80-9871-e86ec9f8e105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.811163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-9efebb65-eb94-4e80-9871-e86ec9f8e105 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:40.812583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9efebb65-eb94-4e80-9871-e86ec9f8e105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:40.822987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1095/2164] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:40.831881 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb8ba-668d-410b-8290-d4abec6029a7 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.832723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb8ba-668d-410b-8290-d4abec6029a7 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.833077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb8ba-668d-410b-8290-d4abec6029a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.838873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1070/2165] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:40 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:40.844169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327c99-a352-4cc3-a83f-c1ed4965f3fa admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:40.846093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7d327c99-a352-4cc3-a83f-c1ed4965f3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:40.858688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-95ffb8ba-668d-410b-8290-d4abec6029a7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:40.860159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-95ffb8ba-668d-410b-8290-d4abec6029a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:40.861375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327c99-a352-4cc3-a83f-c1ed4965f3fa admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:40.866809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1b27c-c776-4c51-8f5e-2c5371cc0970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:40.867473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b27c-c776-4c51-8f5e-2c5371cc0970 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.867800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b27c-c776-4c51-8f5e-2c5371cc0970 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.872960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b27c-c776-4c51-8f5e-2c5371cc0970 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.872960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1b27c-c776-4c51-8f5e-2c5371cc0970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:40.873229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1096/2166] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:40.873350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1b27c-c776-4c51-8f5e-2c5371cc0970 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:40.875779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffb8ba-668d-410b-8290-d4abec6029a7 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:40.883623 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1071/2167] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:40.886676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1b27c-c776-4c51-8f5e-2c5371cc0970 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:40.888868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffb8ba-668d-410b-8290-d4abec6029a7 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:40.893831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4d6b-82ad-4e54-afae-b9a13f41ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:40.894760 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4d6b-82ad-4e54-afae-b9a13f41ac71 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.895197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4d6b-82ad-4e54-afae-b9a13f41ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.895872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4d6b-82ad-4e54-afae-b9a13f41ac71 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.897487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a4d6b-82ad-4e54-afae-b9a13f41ac71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:06:40.898031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a4d6b-82ad-4e54-afae-b9a13f41ac71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:40.899805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a4d6b-82ad-4e54-afae-b9a13f41ac71 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:40.900744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1b27c-c776-4c51-8f5e-2c5371cc0970 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:40.906020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af4cfd-e11e-4653-a82a-05b5a84e5387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:40.907923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af4cfd-e11e-4653-a82a-05b5a84e5387 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.907923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af4cfd-e11e-4653-a82a-05b5a84e5387 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.907923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af4cfd-e11e-4653-a82a-05b5a84e5387 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.908284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af4cfd-e11e-4653-a82a-05b5a84e5387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:40.910047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af4cfd-e11e-4653-a82a-05b5a84e5387 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:40.915610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1097/2168] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:06:40.918446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4d6b-82ad-4e54-afae-b9a13f41ac71 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:40.924868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1072/2169] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:40.926204 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af4cfd-e11e-4653-a82a-05b5a84e5387 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:40.928748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4d6b-82ad-4e54-afae-b9a13f41ac71 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:40.934075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9a61-5ad2-4f61-b157-193b6314a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:40.935551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9a61-5ad2-4f61-b157-193b6314a67b admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.935963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9a61-5ad2-4f61-b157-193b6314a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.936324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9a61-5ad2-4f61-b157-193b6314a67b admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.936581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af4cfd-e11e-4653-a82a-05b5a84e5387 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:40.937378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b9a61-5ad2-4f61-b157-193b6314a67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:40.939575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b9a61-5ad2-4f61-b157-193b6314a67b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:40.943841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440984c-42aa-4006-866c-75465295be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:40.943841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440984c-42aa-4006-866c-75465295be32 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:40.943841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440984c-42aa-4006-866c-75465295be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:40.943841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440984c-42aa-4006-866c-75465295be32 admin admin] PATH_INFO: `/v3/projects/3cf7abc1ea5045d38a0de50dc0329414/users/4c0fd4ca901d43a2a881b9705310f618/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:40.960092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440984c-42aa-4006-866c-75465295be32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf7abc1ea5045d38a0de50dc0329414, user_id=4c0fd4ca901d43a2a881b9705310f618, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:40.963981 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440984c-42aa-4006-866c-75465295be32 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.063541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1073/2170] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:40 2022] PUT /identity/v3/projects/3cf7abc1ea5045d38a0de50dc0329414/users/4c0fd4ca901d43a2a881b9705310f618/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:41.077306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0642-bb21-427e-a303-d9795b076c29 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.077594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0642-bb21-427e-a303-d9795b076c29 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.077873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0642-bb21-427e-a303-d9795b076c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.084403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1098/2171] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:40 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:41.087132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9a61-5ad2-4f61-b157-193b6314a67b admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.125135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c27c0642-bb21-427e-a303-d9795b076c29 None None] MFA Rules not processed for user `4c0fd4ca901d43a2a881b9705310f618`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:41.126425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c27c0642-bb21-427e-a303-d9795b076c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:41.130315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:41.197635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9a61-5ad2-4f61-b157-193b6314a67b admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:41.203197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919648b-17c3-4cb4-b5f8-a697c7ddfc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:41.203909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919648b-17c3-4cb4-b5f8-a697c7ddfc71 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.204217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919648b-17c3-4cb4-b5f8-a697c7ddfc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.204497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919648b-17c3-4cb4-b5f8-a697c7ddfc71 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.205182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919648b-17c3-4cb4-b5f8-a697c7ddfc71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:41.207106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919648b-17c3-4cb4-b5f8-a697c7ddfc71 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.218941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1074/2172] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:41.223434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0642-bb21-427e-a303-d9795b076c29 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.240165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0642-bb21-427e-a303-d9795b076c29 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:41.246491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a01d-6a6c-4f1c-bfcf-becfe7642933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:41.247285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a01d-6a6c-4f1c-bfcf-becfe7642933 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.247772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a01d-6a6c-4f1c-bfcf-becfe7642933 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.248197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a01d-6a6c-4f1c-bfcf-becfe7642933 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.248990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910a01d-6a6c-4f1c-bfcf-becfe7642933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:41.252035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910a01d-6a6c-4f1c-bfcf-becfe7642933 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.335465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1099/2173] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:41 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:41.339761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919648b-17c3-4cb4-b5f8-a697c7ddfc71 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.350616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919648b-17c3-4cb4-b5f8-a697c7ddfc71 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:41.355585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84787bc-ffcc-4843-a021-6d2188290a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:41.356240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84787bc-ffcc-4843-a021-6d2188290a2f admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.356529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84787bc-ffcc-4843-a021-6d2188290a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.356805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84787bc-ffcc-4843-a021-6d2188290a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.357527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84787bc-ffcc-4843-a021-6d2188290a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:41.359143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84787bc-ffcc-4843-a021-6d2188290a2f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.369755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1100/2174] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:41.375269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84787bc-ffcc-4843-a021-6d2188290a2f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.392617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84787bc-ffcc-4843-a021-6d2188290a2f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:41.400588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38057515-c060-4d8c-8a1b-cc700c12bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:41.402171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38057515-c060-4d8c-8a1b-cc700c12bd22 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.402692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38057515-c060-4d8c-8a1b-cc700c12bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.403245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38057515-c060-4d8c-8a1b-cc700c12bd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.404695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38057515-c060-4d8c-8a1b-cc700c12bd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:41.407845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38057515-c060-4d8c-8a1b-cc700c12bd22 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.412059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1075/2175] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:41 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:41.416058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a01d-6a6c-4f1c-bfcf-becfe7642933 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.421864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1101/2176] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:06:41.427548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38057515-c060-4d8c-8a1b-cc700c12bd22 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.440577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38057515-c060-4d8c-8a1b-cc700c12bd22 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:41.521952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57481af-5cdb-4d04-aa8f-e5abc9be1fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:41.522838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57481af-5cdb-4d04-aa8f-e5abc9be1fad admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.523117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57481af-5cdb-4d04-aa8f-e5abc9be1fad admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.523390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57481af-5cdb-4d04-aa8f-e5abc9be1fad admin admin] PATH_INFO: `/v3/projects/e8cdff34f2b54b708295b3fa14e33cf1/users/235a1d57f6ba448fbf23dbf25ff2983c/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.532927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a01d-6a6c-4f1c-bfcf-becfe7642933 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:41.542626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3480ae-f18e-460b-a6e3-4d50313f406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:41.543779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3480ae-f18e-460b-a6e3-4d50313f406c admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.544347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3480ae-f18e-460b-a6e3-4d50313f406c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.544478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57481af-5cdb-4d04-aa8f-e5abc9be1fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cdff34f2b54b708295b3fa14e33cf1, user_id=235a1d57f6ba448fbf23dbf25ff2983c, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:41.544857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3480ae-f18e-460b-a6e3-4d50313f406c admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.546415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3480ae-f18e-460b-a6e3-4d50313f406c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:41.547840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57481af-5cdb-4d04-aa8f-e5abc9be1fad admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.549910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3480ae-f18e-460b-a6e3-4d50313f406c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.645517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1102/2177] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:41 2022] PUT /identity/v3/projects/e8cdff34f2b54b708295b3fa14e33cf1/users/235a1d57f6ba448fbf23dbf25ff2983c/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:41.651026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d35405-867d-4165-a6d2-04ce383507b2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.651317 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d35405-867d-4165-a6d2-04ce383507b2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.651622 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d35405-867d-4165-a6d2-04ce383507b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.656320 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1076/2178] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:41 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:41.664814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3480ae-f18e-460b-a6e3-4d50313f406c admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.677362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-84d35405-867d-4165-a6d2-04ce383507b2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:41.678950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-84d35405-867d-4165-a6d2-04ce383507b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:41.693287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3480ae-f18e-460b-a6e3-4d50313f406c admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:41.755932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1103/2179] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:41.764501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164449c-c7a6-48b9-ab7e-a5bde517e069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:41.765433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164449c-c7a6-48b9-ab7e-a5bde517e069 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.766078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164449c-c7a6-48b9-ab7e-a5bde517e069 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.766355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164449c-c7a6-48b9-ab7e-a5bde517e069 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.767167 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164449c-c7a6-48b9-ab7e-a5bde517e069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:41.768817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164449c-c7a6-48b9-ab7e-a5bde517e069 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.772647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d35405-867d-4165-a6d2-04ce383507b2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.774487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-84d35405-867d-4165-a6d2-04ce383507b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:41.781653 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1077/2180] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:41.788840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164449c-c7a6-48b9-ab7e-a5bde517e069 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.800446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164449c-c7a6-48b9-ab7e-a5bde517e069 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:41.805399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b94184-c425-42d0-a462-2a176f4ea4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:41.806287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b94184-c425-42d0-a462-2a176f4ea4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.806568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b94184-c425-42d0-a462-2a176f4ea4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.806870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b94184-c425-42d0-a462-2a176f4ea4a1 admin admin] PATH_INFO: `/v3/projects/44f054cf30aa4e23bff0e2ecdec97e19/users/fbbd9dba8ce54fb88c107ac1087f153a/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.844755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b94184-c425-42d0-a462-2a176f4ea4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f054cf30aa4e23bff0e2ecdec97e19, user_id=fbbd9dba8ce54fb88c107ac1087f153a, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:41.845966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:41.847816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b94184-c425-42d0-a462-2a176f4ea4a1 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.869009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d35405-867d-4165-a6d2-04ce383507b2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:41.875056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3dd05-7d1a-4c42-a39f-98950e12df3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:41.875651 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3dd05-7d1a-4c42-a39f-98950e12df3b service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:41.875937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3dd05-7d1a-4c42-a39f-98950e12df3b service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:41.876210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3dd05-7d1a-4c42-a39f-98950e12df3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:41.886125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3dd05-7d1a-4c42-a39f-98950e12df3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:41.887780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3dd05-7d1a-4c42-a39f-98950e12df3b service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:41.897775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1104/2181] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:06:41.957682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1078/2182] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:41 2022] PUT /identity/v3/projects/44f054cf30aa4e23bff0e2ecdec97e19/users/fbbd9dba8ce54fb88c107ac1087f153a/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:41.961548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3dd05-7d1a-4c42-a39f-98950e12df3b service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:41.971417 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3dd05-7d1a-4c42-a39f-98950e12df3b service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:42.028605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb0ee5-dde4-4545-bc16-3687f9e7a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:42.029267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb0ee5-dde4-4545-bc16-3687f9e7a98e admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:42.029554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb0ee5-dde4-4545-bc16-3687f9e7a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:42.029837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb0ee5-dde4-4545-bc16-3687f9e7a98e admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:42.030600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb0ee5-dde4-4545-bc16-3687f9e7a98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:42.032257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb0ee5-dde4-4545-bc16-3687f9e7a98e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:42.042617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1105/2183] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:42.049510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b94184-c425-42d0-a462-2a176f4ea4a1 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:42.063262 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b94184-c425-42d0-a462-2a176f4ea4a1 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:42.074065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba305d9-179a-4ae8-9433-5b2cf3f1ca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:42.074065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba305d9-179a-4ae8-9433-5b2cf3f1ca2e admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:42.074065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba305d9-179a-4ae8-9433-5b2cf3f1ca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:42.074065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba305d9-179a-4ae8-9433-5b2cf3f1ca2e admin admin] PATH_INFO: `/v3/projects/44f054cf30aa4e23bff0e2ecdec97e19/users/fbbd9dba8ce54fb88c107ac1087f153a/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:42.074486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba305d9-179a-4ae8-9433-5b2cf3f1ca2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f054cf30aa4e23bff0e2ecdec97e19, user_id=fbbd9dba8ce54fb88c107ac1087f153a, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:42.077080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba305d9-179a-4ae8-9433-5b2cf3f1ca2e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:42.095540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1079/2184] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:42 2022] PUT /identity/v3/projects/44f054cf30aa4e23bff0e2ecdec97e19/users/fbbd9dba8ce54fb88c107ac1087f153a/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:42.101049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24012345-0994-4fa7-9dec-a31e8e703717 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:42.102628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24012345-0994-4fa7-9dec-a31e8e703717 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:42.102628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24012345-0994-4fa7-9dec-a31e8e703717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:42.130832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-24012345-0994-4fa7-9dec-a31e8e703717 None None] MFA Rules not processed for user `fbbd9dba8ce54fb88c107ac1087f153a`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:42.132197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-24012345-0994-4fa7-9dec-a31e8e703717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:42.203988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1106/2185] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:42.216631 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba305d9-179a-4ae8-9433-5b2cf3f1ca2e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:42.218697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3ba305d9-179a-4ae8-9433-5b2cf3f1ca2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:42.278402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba305d9-179a-4ae8-9433-5b2cf3f1ca2e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:42.282147 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5a762-850b-4914-b667-c4ac2f946d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:42.282798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5a762-850b-4914-b667-c4ac2f946d4e service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:42.283969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5a762-850b-4914-b667-c4ac2f946d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:42.284268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5a762-850b-4914-b667-c4ac2f946d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:42.286983 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f7b5a762-850b-4914-b667-c4ac2f946d4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:42.372674 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5a762-850b-4914-b667-c4ac2f946d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:42.374500 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5a762-850b-4914-b667-c4ac2f946d4e service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:42.387505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1080/2186] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:42.528530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:42.816134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:44.062243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:44.169483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:44.815016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24012345-0994-4fa7-9dec-a31e8e703717 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:44.835487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24012345-0994-4fa7-9dec-a31e8e703717 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:44.840155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8bc87-e68b-4aed-8bcf-5c9d361bd994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:44.840842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8bc87-e68b-4aed-8bcf-5c9d361bd994 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:44.841607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8bc87-e68b-4aed-8bcf-5c9d361bd994 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:44.842143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8bc87-e68b-4aed-8bcf-5c9d361bd994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:44.962195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8bc87-e68b-4aed-8bcf-5c9d361bd994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:44.963698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8bc87-e68b-4aed-8bcf-5c9d361bd994 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:44.979531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1107/2187] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:46.050621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:46.554421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:47.284149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:47.431381 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5a762-850b-4914-b667-c4ac2f946d4e service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:47.450275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5a762-850b-4914-b667-c4ac2f946d4e service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:47.465745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616c74c-8e3f-46f5-ac56-7b1c3fc8bbec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:47.467078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616c74c-8e3f-46f5-ac56-7b1c3fc8bbec service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:47.467556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616c74c-8e3f-46f5-ac56-7b1c3fc8bbec service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:47.467921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616c74c-8e3f-46f5-ac56-7b1c3fc8bbec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:47.494800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616c74c-8e3f-46f5-ac56-7b1c3fc8bbec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:47.496627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616c74c-8e3f-46f5-ac56-7b1c3fc8bbec service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:47.523652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1081/2188] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:48.357947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:49.895792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:50.294654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477aa6-d2db-49e0-925f-be7219c42aa1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:50.295042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477aa6-d2db-49e0-925f-be7219c42aa1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:50.295415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477aa6-d2db-49e0-925f-be7219c42aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:50.346732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-a9477aa6-d2db-49e0-925f-be7219c42aa1 None None] MFA Rules not processed for user `235a1d57f6ba448fbf23dbf25ff2983c`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:50.350217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a9477aa6-d2db-49e0-925f-be7219c42aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:50.479336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1108/2189] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:50.483841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616c74c-8e3f-46f5-ac56-7b1c3fc8bbec service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:50.596793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616c74c-8e3f-46f5-ac56-7b1c3fc8bbec service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:50.621577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdec85-e502-4534-8205-df9c592c5f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:50.622750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdec85-e502-4534-8205-df9c592c5f81 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:50.623258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdec85-e502-4534-8205-df9c592c5f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:50.623805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdec85-e502-4534-8205-df9c592c5f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:50.625468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdec85-e502-4534-8205-df9c592c5f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:50.628122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdec85-e502-4534-8205-df9c592c5f81 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:50.782841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1082/2190] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:06:50 2022] POST /identity/v3/projects => generated 383 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:06:50.784097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9477aa6-d2db-49e0-925f-be7219c42aa1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:50.808051 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9477aa6-d2db-49e0-925f-be7219c42aa1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:50.907625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f15b-30e0-41ee-a072-1f6c3a0cea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:50.909048 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f15b-30e0-41ee-a072-1f6c3a0cea38 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:50.909328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f15b-30e0-41ee-a072-1f6c3a0cea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:50.909599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f15b-30e0-41ee-a072-1f6c3a0cea38 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:50.910296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f15b-30e0-41ee-a072-1f6c3a0cea38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:50.913012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f15b-30e0-41ee-a072-1f6c3a0cea38 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:50.941010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:50.982727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30a8e1-3f8f-4028-a56f-439391a1ab4e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:50.982866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30a8e1-3f8f-4028-a56f-439391a1ab4e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:50.983112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30a8e1-3f8f-4028-a56f-439391a1ab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:51.010830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1109/2191] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:06:50 2022] POST /identity/v3/users => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:06:51.022652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f15b-30e0-41ee-a072-1f6c3a0cea38 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:51.028252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8f30a8e1-3f8f-4028-a56f-439391a1ab4e None None] MFA Rules not processed for user `62b8c8b994e54023933a4ff2ecf68f42`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:51.029598 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8f30a8e1-3f8f-4028-a56f-439391a1ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:51.051148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f15b-30e0-41ee-a072-1f6c3a0cea38 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:51.075655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8415e-c5cc-4783-97f3-d407c48ea284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:51.076347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8415e-c5cc-4783-97f3-d407c48ea284 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:51.076635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8415e-c5cc-4783-97f3-d407c48ea284 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:51.076899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8415e-c5cc-4783-97f3-d407c48ea284 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:51.077634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8415e-c5cc-4783-97f3-d407c48ea284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:51.079357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8415e-c5cc-4783-97f3-d407c48ea284 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:51.135060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1110/2192] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:51.135060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8415e-c5cc-4783-97f3-d407c48ea284 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:51.148782 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8415e-c5cc-4783-97f3-d407c48ea284 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:51.165386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c47a8e-47a1-4183-926f-fea16dbe9b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:51.166730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c47a8e-47a1-4183-926f-fea16dbe9b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:51.167408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c47a8e-47a1-4183-926f-fea16dbe9b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:51.167876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c47a8e-47a1-4183-926f-fea16dbe9b0a admin admin] PATH_INFO: `/v3/projects/af58720a67b44e7db1092d4ad61520c3/users/f4f142b404b04ccdb561ea14b3373a04/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:51.199371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1083/2193] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:51.212923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c47a8e-47a1-4183-926f-fea16dbe9b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af58720a67b44e7db1092d4ad61520c3, user_id=f4f142b404b04ccdb561ea14b3373a04, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:51.216537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c47a8e-47a1-4183-926f-fea16dbe9b0a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:51.490539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1111/2194] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:51 2022] PUT /identity/v3/projects/af58720a67b44e7db1092d4ad61520c3/users/f4f142b404b04ccdb561ea14b3373a04/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:51.494670 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30a8e1-3f8f-4028-a56f-439391a1ab4e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:51.519602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30a8e1-3f8f-4028-a56f-439391a1ab4e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:51.672495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a28b-47be-4563-ac79-e1815fbf985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:51.673432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a28b-47be-4563-ac79-e1815fbf985c admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:51.673871 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a28b-47be-4563-ac79-e1815fbf985c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:51.674299 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a28b-47be-4563-ac79-e1815fbf985c admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:51.675173 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9a28b-47be-4563-ac79-e1815fbf985c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:51.677135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9a28b-47be-4563-ac79-e1815fbf985c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:51.679656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010fa12-d470-42cb-9267-9fadbbfea35c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:51.680356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010fa12-d470-42cb-9267-9fadbbfea35c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:51.680890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010fa12-d470-42cb-9267-9fadbbfea35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:51.713875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5010fa12-d470-42cb-9267-9fadbbfea35c None None] MFA Rules not processed for user `f4794216544c4b969910eb48c2769f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:51.715612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5010fa12-d470-42cb-9267-9fadbbfea35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:51.722879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1084/2195] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:06:51.725460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a28b-47be-4563-ac79-e1815fbf985c admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:51.746429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a28b-47be-4563-ac79-e1815fbf985c admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:51.754238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98306-0887-45ad-935d-0a0817368461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:51.755450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98306-0887-45ad-935d-0a0817368461 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:51.756040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98306-0887-45ad-935d-0a0817368461 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:51.756495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98306-0887-45ad-935d-0a0817368461 admin admin] PATH_INFO: `/v3/projects/af58720a67b44e7db1092d4ad61520c3/users/f4f142b404b04ccdb561ea14b3373a04/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:51.759431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa98306-0887-45ad-935d-0a0817368461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af58720a67b44e7db1092d4ad61520c3, user_id=f4f142b404b04ccdb561ea14b3373a04, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:51.762930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa98306-0887-45ad-935d-0a0817368461 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:51.782126 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1085/2196] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:06:51 2022] PUT /identity/v3/projects/af58720a67b44e7db1092d4ad61520c3/users/f4f142b404b04ccdb561ea14b3373a04/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:51.804878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1112/2197] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:52.655089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:53.048512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98306-0887-45ad-935d-0a0817368461 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:53.186645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98306-0887-45ad-935d-0a0817368461 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:53.223858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:53.225260 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:53.225822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:53.226938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] PATH_INFO: `/v3/users/c58a89f9c1ad435d9b74317b7b5aaf1a` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:53.228502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c58a89f9c1ad435d9b74317b7b5aaf1a)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:53.231489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:53.506393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c58a89f9c1ad435d9b74317b7b5aaf1a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:53.514487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c58a89f9c1ad435d9b74317b7b5aaf1a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:53.515337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c58a89f9c1ad435d9b74317b7b5aaf1a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:53.532031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c58a89f9c1ad435d9b74317b7b5aaf1a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:53.533026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c58a89f9c1ad435d9b74317b7b5aaf1a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:53.626555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1086/2198] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:53 2022] DELETE /identity/v3/users/c58a89f9c1ad435d9b74317b7b5aaf1a => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:53.632483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8ef2-ee14-4cdb-bc7f-032008f9fc0d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:53.632993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8ef2-ee14-4cdb-bc7f-032008f9fc0d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:53.633085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8ef2-ee14-4cdb-bc7f-032008f9fc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:53.667394 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-23ff8ef2-ee14-4cdb-bc7f-032008f9fc0d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:53.674124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-23ff8ef2-ee14-4cdb-bc7f-032008f9fc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:53.814871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1113/2199] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:06:53.826717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:53.835987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:53.946017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db24e27-b568-49d3-8df9-4131c8fae706 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:53.954100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75607096-795b-43d5-8e4b-848e92026ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:53.954921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75607096-795b-43d5-8e4b-848e92026ccc service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:53.955279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75607096-795b-43d5-8e4b-848e92026ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:53.955654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75607096-795b-43d5-8e4b-848e92026ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:53.969843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75607096-795b-43d5-8e4b-848e92026ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:53.971495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75607096-795b-43d5-8e4b-848e92026ccc service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:53.983328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1087/2200] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:54.249926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd084-9ffa-4f00-8a68-ad94ca741f78 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:54.250151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd084-9ffa-4f00-8a68-ad94ca741f78 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:54.250394 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd084-9ffa-4f00-8a68-ad94ca741f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:54.275376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3d9dd084-9ffa-4f00-8a68-ad94ca741f78 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:06:54.276825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3d9dd084-9ffa-4f00-8a68-ad94ca741f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:54.362048 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1114/2201] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:06:54.376524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75607096-795b-43d5-8e4b-848e92026ccc service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:54.378339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-75607096-795b-43d5-8e4b-848e92026ccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:54.490132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:54.556932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75607096-795b-43d5-8e4b-848e92026ccc service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:54.565429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a27c5e-d08f-4258-9bb1-817705ed5616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:54.566894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a27c5e-d08f-4258-9bb1-817705ed5616 service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:54.568709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a27c5e-d08f-4258-9bb1-817705ed5616 service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:54.569165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a27c5e-d08f-4258-9bb1-817705ed5616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:54.586953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a27c5e-d08f-4258-9bb1-817705ed5616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:54.589696 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a27c5e-d08f-4258-9bb1-817705ed5616 service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:54.602785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1088/2202] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:06:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:06:54.928240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd084-9ffa-4f00-8a68-ad94ca741f78 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:54.930230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3d9dd084-9ffa-4f00-8a68-ad94ca741f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:54.956515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd084-9ffa-4f00-8a68-ad94ca741f78 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:54.964165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:54.965415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:54.966436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:54.967172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] PATH_INFO: `/v3/projects/2056a72bcd9e4f348cd87f90b05e837d` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:54.968928 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2056a72bcd9e4f348cd87f90b05e837d)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:54.971551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:55.233144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2056a72bcd9e4f348cd87f90b05e837d', 'request_id': 'req-846411a9-420d-4fed-a818-9664e177c0f1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:55.263729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2056a72bcd9e4f348cd87f90b05e837d', 'request_id': 'req-846411a9-420d-4fed-a818-9664e177c0f1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:55.294110 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2056a72bcd9e4f348cd87f90b05e837d', 'request_id': 'req-846411a9-420d-4fed-a818-9664e177c0f1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:55.370778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] The token cache is being invalidate because project 2056a72bcd9e4f348cd87f90b05e837d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:55.371060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:55.372003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:55.374040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1115/2203] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:54 2022] DELETE /identity/v3/projects/2056a72bcd9e4f348cd87f90b05e837d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:55.378041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a27c5e-d08f-4258-9bb1-817705ed5616 service swift] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:55.393012 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a27c5e-d08f-4258-9bb1-817705ed5616 service swift] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:55.587868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:55.591298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:55.592095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:55.595127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] PATH_INFO: `/v3/users/4c0fd4ca901d43a2a881b9705310f618` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:55.597724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0fd4ca901d43a2a881b9705310f618)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:55.602228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:56.003492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0fd4ca901d43a2a881b9705310f618'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:56.170687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0fd4ca901d43a2a881b9705310f618'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:56.170687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0fd4ca901d43a2a881b9705310f618'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:56.170687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0fd4ca901d43a2a881b9705310f618'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:56.170687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0fd4ca901d43a2a881b9705310f618'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:56.602443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1089/2204] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:55 2022] DELETE /identity/v3/users/4c0fd4ca901d43a2a881b9705310f618 => generated 0 bytes in 1225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:56.706999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:57.592531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:57.884666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:57.886154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:57.907610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846411a9-420d-4fed-a818-9664e177c0f1 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:58.028983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:58.029969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:58.030890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:58.030890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] PATH_INFO: `/v3/projects/3cf7abc1ea5045d38a0de50dc0329414` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:58.032154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf7abc1ea5045d38a0de50dc0329414)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:58.042263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:58.205525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf7abc1ea5045d38a0de50dc0329414', 'request_id': 'req-b743b6e6-9dbd-4fed-9f88-95b75318becc'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.216232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf7abc1ea5045d38a0de50dc0329414', 'request_id': 'req-b743b6e6-9dbd-4fed-9f88-95b75318becc'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.233111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf7abc1ea5045d38a0de50dc0329414', 'request_id': 'req-b743b6e6-9dbd-4fed-9f88-95b75318becc'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.342199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] The token cache is being invalidate because project 3cf7abc1ea5045d38a0de50dc0329414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:58.342199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.342816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.345513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1116/2205] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:06:57 2022] DELETE /identity/v3/projects/3cf7abc1ea5045d38a0de50dc0329414 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:58.350013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:58.356600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:58.393273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33359a39-b63d-432c-b531-e7d51c202b16 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:58.506465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:58.524065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:58.525458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:58.525893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:58.526325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] PATH_INFO: `/v3/users/fbbd9dba8ce54fb88c107ac1087f153a` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:58.527892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbd9dba8ce54fb88c107ac1087f153a)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:58.530786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:58.802623 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbd9dba8ce54fb88c107ac1087f153a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.815828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbd9dba8ce54fb88c107ac1087f153a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.818961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbd9dba8ce54fb88c107ac1087f153a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.853649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbd9dba8ce54fb88c107ac1087f153a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.855184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2af4d2a5-bd4c-412c-b166-62fa5b6b54a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbd9dba8ce54fb88c107ac1087f153a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:58.991916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1090/2206] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:06:58 2022] DELETE /identity/v3/users/fbbd9dba8ce54fb88c107ac1087f153a => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:59.252934 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:59.748405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:00.003790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:00.421052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:00.472607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:00.475823 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:00.502567 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743b6e6-9dbd-4fed-9f88-95b75318becc admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:00.717091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:00.718549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:00.723405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:00.723405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] PATH_INFO: `/v3/projects/44f054cf30aa4e23bff0e2ecdec97e19` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:00.723405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f054cf30aa4e23bff0e2ecdec97e19)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:00.728147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:00.933531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f054cf30aa4e23bff0e2ecdec97e19', 'request_id': 'req-51d8b336-2ba7-4195-a021-7a333a6951b8'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:00.962430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f054cf30aa4e23bff0e2ecdec97e19', 'request_id': 'req-51d8b336-2ba7-4195-a021-7a333a6951b8'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:00.978526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f054cf30aa4e23bff0e2ecdec97e19', 'request_id': 'req-51d8b336-2ba7-4195-a021-7a333a6951b8'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:01.088727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] The token cache is being invalidate because project 44f054cf30aa4e23bff0e2ecdec97e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:07:01.089263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:01.090153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-51d8b336-2ba7-4195-a021-7a333a6951b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:01.096584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1117/2207] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:07:00 2022] DELETE /identity/v3/projects/44f054cf30aa4e23bff0e2ecdec97e19 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:07:01.102949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd64183-9b50-4f09-b987-ee76516bfb99 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:01.105932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd64183-9b50-4f09-b987-ee76516bfb99 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:01.105932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd64183-9b50-4f09-b987-ee76516bfb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:01.151269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-7bd64183-9b50-4f09-b987-ee76516bfb99 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:01.155347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7bd64183-9b50-4f09-b987-ee76516bfb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:01.160272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:01.243877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:01.362010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1091/2208] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:01.383094 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5c23-7830-4b4f-957f-55b86010e92f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:01.385373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5c23-7830-4b4f-957f-55b86010e92f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:01.385942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5c23-7830-4b4f-957f-55b86010e92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:01.496740 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b8cf5c23-7830-4b4f-957f-55b86010e92f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:01.498178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b8cf5c23-7830-4b4f-957f-55b86010e92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:01.544728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1118/2209] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:07:01.545381 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd64183-9b50-4f09-b987-ee76516bfb99 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:01.561077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd64183-9b50-4f09-b987-ee76516bfb99 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:01.573831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c795f-f597-4cc0-9d5e-0f78b5f6d8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:01.574093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c795f-f597-4cc0-9d5e-0f78b5f6d8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:01.574574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c795f-f597-4cc0-9d5e-0f78b5f6d8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:01.574574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c795f-f597-4cc0-9d5e-0f78b5f6d8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:01.575332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c795f-f597-4cc0-9d5e-0f78b5f6d8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:07:01.575667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c795f-f597-4cc0-9d5e-0f78b5f6d8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:01.577493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c795f-f597-4cc0-9d5e-0f78b5f6d8f8 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:01.608619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1092/2210] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:07:01.609929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5c23-7830-4b4f-957f-55b86010e92f None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:01.621796 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5c23-7830-4b4f-957f-55b86010e92f None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:01.627018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3b138-6ea6-40ce-b1dd-48c3a36a1e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:01.627737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3b138-6ea6-40ce-b1dd-48c3a36a1e40 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:01.628020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3b138-6ea6-40ce-b1dd-48c3a36a1e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:01.628295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3b138-6ea6-40ce-b1dd-48c3a36a1e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:01.628992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3b138-6ea6-40ce-b1dd-48c3a36a1e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:01.630983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3b138-6ea6-40ce-b1dd-48c3a36a1e40 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:02.070385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1119/2211] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:07:01 2022] POST /identity/v3/projects => generated 371 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:07:02.075619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c795f-f597-4cc0-9d5e-0f78b5f6d8f8 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:02.123186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c795f-f597-4cc0-9d5e-0f78b5f6d8f8 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:02.281546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048dbee-5f9a-4d5a-b26c-d27acb9bf1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:02.282241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048dbee-5f9a-4d5a-b26c-d27acb9bf1de admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:02.288930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048dbee-5f9a-4d5a-b26c-d27acb9bf1de admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:02.289214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048dbee-5f9a-4d5a-b26c-d27acb9bf1de admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:02.289958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048dbee-5f9a-4d5a-b26c-d27acb9bf1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:02.295341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048dbee-5f9a-4d5a-b26c-d27acb9bf1de admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:02.415085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1093/2212] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:07:02 2022] POST /identity/v3/users => generated 286 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:07:02.419766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3b138-6ea6-40ce-b1dd-48c3a36a1e40 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:02.436824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3b138-6ea6-40ce-b1dd-48c3a36a1e40 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:02.453820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3479272-3327-4b9a-bc44-55aa2cba21b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:02.454731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3479272-3327-4b9a-bc44-55aa2cba21b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:02.459655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3479272-3327-4b9a-bc44-55aa2cba21b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:02.459972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3479272-3327-4b9a-bc44-55aa2cba21b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:02.460761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3479272-3327-4b9a-bc44-55aa2cba21b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:02.462411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3479272-3327-4b9a-bc44-55aa2cba21b0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:02.496368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1120/2213] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:07:02.498665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048dbee-5f9a-4d5a-b26c-d27acb9bf1de admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:02.512733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048dbee-5f9a-4d5a-b26c-d27acb9bf1de admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:02.532664 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a4273-a7a2-442d-b6cd-b5366e847bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:02.536200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a4273-a7a2-442d-b6cd-b5366e847bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:02.536510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a4273-a7a2-442d-b6cd-b5366e847bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:02.536783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a4273-a7a2-442d-b6cd-b5366e847bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:02.537533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a4273-a7a2-442d-b6cd-b5366e847bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:02.545260 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a4273-a7a2-442d-b6cd-b5366e847bc7 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:02.571220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1094/2214] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:07:02.574272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3479272-3327-4b9a-bc44-55aa2cba21b0 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:02.588006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3479272-3327-4b9a-bc44-55aa2cba21b0 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:02.603087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe7606-5555-4636-a187-9c7efda32fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:02.604464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe7606-5555-4636-a187-9c7efda32fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:02.604910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe7606-5555-4636-a187-9c7efda32fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:02.605334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe7606-5555-4636-a187-9c7efda32fc9 admin admin] PATH_INFO: `/v3/projects/d6b2851acd1e4ec687acc2fc8e6e2bb9/users/3e4d4c6fab754c23b92d3dd8651cebf9/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:02.647837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe7606-5555-4636-a187-9c7efda32fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b2851acd1e4ec687acc2fc8e6e2bb9, user_id=3e4d4c6fab754c23b92d3dd8651cebf9, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:02.650859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe7606-5555-4636-a187-9c7efda32fc9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:02.777182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1121/2215] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:07:02 2022] PUT /identity/v3/projects/d6b2851acd1e4ec687acc2fc8e6e2bb9/users/3e4d4c6fab754c23b92d3dd8651cebf9/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:07:02.778491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07890a-1b42-4499-9ffe-d03cb920f1fa None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:02.778783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07890a-1b42-4499-9ffe-d03cb920f1fa None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:02.779063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07890a-1b42-4499-9ffe-d03cb920f1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:02.841175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1c07890a-1b42-4499-9ffe-d03cb920f1fa None None] MFA Rules not processed for user `3e4d4c6fab754c23b92d3dd8651cebf9`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:02.842613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1c07890a-1b42-4499-9ffe-d03cb920f1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:02.855053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:02.896259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:03.097535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1095/2216] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:03.114513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe7606-5555-4636-a187-9c7efda32fc9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:03.118742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e4fe7606-5555-4636-a187-9c7efda32fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:03.310151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe7606-5555-4636-a187-9c7efda32fc9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:03.325280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c9f9e-2746-4824-80cd-0535ba78e2ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4145a3bf87a94f4e9d39e16dc483595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:03.327274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c9f9e-2746-4824-80cd-0535ba78e2ef service glance] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:03.327977 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c9f9e-2746-4824-80cd-0535ba78e2ef service glance] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:03.328695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c9f9e-2746-4824-80cd-0535ba78e2ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:03.349411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c9f9e-2746-4824-80cd-0535ba78e2ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:03.351003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c9f9e-2746-4824-80cd-0535ba78e2ef service glance] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:03.390239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1122/2217] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:07:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:04.169745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:04.285256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:05.517317 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:05.712113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc7e2b-7dd4-4438-be99-f86afaaeebb6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:05.712654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc7e2b-7dd4-4438-be99-f86afaaeebb6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:05.712654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc7e2b-7dd4-4438-be99-f86afaaeebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:05.787516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:05.791199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-94dc7e2b-7dd4-4438-be99-f86afaaeebb6 None None] MFA Rules not processed for user `f4f142b404b04ccdb561ea14b3373a04`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:05.794215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-94dc7e2b-7dd4-4438-be99-f86afaaeebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:05.958437 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1096/2218] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:07.882628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:09.202574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:09.478243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:10.013712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:10.569535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:14.850109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c9f9e-2746-4824-80cd-0535ba78e2ef service glance] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:14.852733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5e6c9f9e-2746-4824-80cd-0535ba78e2ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:14.870346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c9f9e-2746-4824-80cd-0535ba78e2ef service glance] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:14.874403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4145a3bf87a94f4e9d39e16dc483595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:14.875087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:14.875363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:14.875724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:14.878126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:14.947157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:14.948645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:14.959889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1123/2219] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:07:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:15.272189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138d2a2-3632-4828-8656-947d5c088c42 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:15.273119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138d2a2-3632-4828-8656-947d5c088c42 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:15.273398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138d2a2-3632-4828-8656-947d5c088c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:15.294720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1138d2a2-3632-4828-8656-947d5c088c42 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:15.295966 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1138d2a2-3632-4828-8656-947d5c088c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:15.366601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1097/2220] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:07:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:15.381332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:15.383682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:15.477780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:15.484511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406796d8-d511-4c8e-90c4-9c62361272f8 service glance] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:15.491303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa806d-c46e-4d29-85d1-7ae43d344d12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:15.492147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa806d-c46e-4d29-85d1-7ae43d344d12 service swift] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:15.492287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa806d-c46e-4d29-85d1-7ae43d344d12 service swift] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:15.492552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa806d-c46e-4d29-85d1-7ae43d344d12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:15.502062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa806d-c46e-4d29-85d1-7ae43d344d12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:15.503679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa806d-c46e-4d29-85d1-7ae43d344d12 service swift] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:15.514749 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1124/2221] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:07:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:07:15.635597 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd5b5-bd01-44d9-aa65-cbfa080381fa None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:15.635878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd5b5-bd01-44d9-aa65-cbfa080381fa None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:15.636159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd5b5-bd01-44d9-aa65-cbfa080381fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:15.657022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-77ddd5b5-bd01-44d9-aa65-cbfa080381fa None None] MFA Rules not processed for user `1fb0244aad5e4e73a43f04681ed6860b`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:15.658374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-77ddd5b5-bd01-44d9-aa65-cbfa080381fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:15.678656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:15.761196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1098/2222] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:24.058138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a1dcc-70a8-4e14-b23b-4fd57c6c4b11 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:24.059133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a1dcc-70a8-4e14-b23b-4fd57c6c4b11 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:24.059616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a1dcc-70a8-4e14-b23b-4fd57c6c4b11 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:24.062851 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1125/2223] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 17:07:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:07:24.067856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769c998-a951-462e-9064-0003fab198c7 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:24.068795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769c998-a951-462e-9064-0003fab198c7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:24.069252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769c998-a951-462e-9064-0003fab198c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:24.160999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f769c998-a951-462e-9064-0003fab198c7 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:24.162351 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f769c998-a951-462e-9064-0003fab198c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:24.319336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1099/2224] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 17:07:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:24.332509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a1dcc-70a8-4e14-b23b-4fd57c6c4b11 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:24.347064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a1dcc-70a8-4e14-b23b-4fd57c6c4b11 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:24.353593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f58ae1-2520-4b10-82f4-39de49060116 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4145a3bf87a94f4e9d39e16dc483595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:24.354525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58ae1-2520-4b10-82f4-39de49060116 service glance] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:24.358468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58ae1-2520-4b10-82f4-39de49060116 service glance] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:24.358468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58ae1-2520-4b10-82f4-39de49060116 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:24.368272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f58ae1-2520-4b10-82f4-39de49060116 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:24.370321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f58ae1-2520-4b10-82f4-39de49060116 service glance] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:24.382839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1126/2225] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:07:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:24.673334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddd6e1-2c21-4b40-9ad5-ed3726192f29 None None] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:24.675775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddd6e1-2c21-4b40-9ad5-ed3726192f29 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:24.676068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddd6e1-2c21-4b40-9ad5-ed3726192f29 None None] PATH_INFO: `/` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:24.677840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1100/2226] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 17:07:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:07:24.682791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bec14-a3f3-4cc7-89a4-e2a4146ed38d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:24.683501 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bec14-a3f3-4cc7-89a4-e2a4146ed38d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:24.684050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bec14-a3f3-4cc7-89a4-e2a4146ed38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:24.709212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-db6bec14-a3f3-4cc7-89a4-e2a4146ed38d None None] MFA Rules not processed for user `8fee665c10364944a8162548f91a431e`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:24.711190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-db6bec14-a3f3-4cc7-89a4-e2a4146ed38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:24.835872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1127/2227] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 17:07:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:07:24.852917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddd6e1-2c21-4b40-9ad5-ed3726192f29 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:24.854955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4eddd6e1-2c21-4b40-9ad5-ed3726192f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:24.885486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddd6e1-2c21-4b40-9ad5-ed3726192f29 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:24.896697 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6a66f-b19d-43cf-a255-759118f4b27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:24.897365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6a66f-b19d-43cf-a255-759118f4b27d service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:24.897652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6a66f-b19d-43cf-a255-759118f4b27d service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:24.898038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6a66f-b19d-43cf-a255-759118f4b27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:24.907135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6a66f-b19d-43cf-a255-759118f4b27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:24.908356 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6a66f-b19d-43cf-a255-759118f4b27d service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:24.917818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1101/2228] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:07:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:25.014511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880120e3-1e14-4e1a-b035-9930efbf4128 None None] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:25.014800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880120e3-1e14-4e1a-b035-9930efbf4128 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:25.015083 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880120e3-1e14-4e1a-b035-9930efbf4128 None None] PATH_INFO: `/` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:25.016640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1128/2229] 10.222.0.93 () {54 vars in 921 bytes} [Thu May 26 17:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:07:25.022397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a1a38-f2dd-418f-ab6e-47fa5f3d42a1 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:25.022942 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a1a38-f2dd-418f-ab6e-47fa5f3d42a1 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:25.023428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a1a38-f2dd-418f-ab6e-47fa5f3d42a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:25.049489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c49a1a38-f2dd-418f-ab6e-47fa5f3d42a1 None None] MFA Rules not processed for user `8dd8a5a74a2947e385ca0cb7f3ee6428`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:25.051712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c49a1a38-f2dd-418f-ab6e-47fa5f3d42a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:25.085881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1102/2230] 10.222.0.93 () {58 vars in 1018 bytes} [Thu May 26 17:07:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:25.098780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880120e3-1e14-4e1a-b035-9930efbf4128 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:25.113028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880120e3-1e14-4e1a-b035-9930efbf4128 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:25.117861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063d14-b8e2-4c19-8335-1d09a3dd694a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:25.118585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063d14-b8e2-4c19-8335-1d09a3dd694a service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:25.119091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063d14-b8e2-4c19-8335-1d09a3dd694a service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:25.119589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063d14-b8e2-4c19-8335-1d09a3dd694a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:25.136980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee063d14-b8e2-4c19-8335-1d09a3dd694a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:25.143065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee063d14-b8e2-4c19-8335-1d09a3dd694a service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:25.157137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1129/2231] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:07:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:28.572659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a734b3-bddb-4e47-a9b7-aa5f08f932d2 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:28.573171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a734b3-bddb-4e47-a9b7-aa5f08f932d2 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:28.573171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a734b3-bddb-4e47-a9b7-aa5f08f932d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:28.592915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e6a734b3-bddb-4e47-a9b7-aa5f08f932d2 None None] MFA Rules not processed for user `235a1d57f6ba448fbf23dbf25ff2983c`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:28.601235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e6a734b3-bddb-4e47-a9b7-aa5f08f932d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:28.601733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1103/2232] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:30.773423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683493c2-c343-4f32-a15e-039ea265f807 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:30.773988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683493c2-c343-4f32-a15e-039ea265f807 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:30.773988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683493c2-c343-4f32-a15e-039ea265f807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:30.792788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-683493c2-c343-4f32-a15e-039ea265f807 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:30.794060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-683493c2-c343-4f32-a15e-039ea265f807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:30.801612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1130/2233] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:07:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:30.813671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a734b3-bddb-4e47-a9b7-aa5f08f932d2 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:30.825718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a734b3-bddb-4e47-a9b7-aa5f08f932d2 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:30.830540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33983be5-c349-4869-b594-1f1dfa40eba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:30.831192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33983be5-c349-4869-b594-1f1dfa40eba8 service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:30.831470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33983be5-c349-4869-b594-1f1dfa40eba8 service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:30.831777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33983be5-c349-4869-b594-1f1dfa40eba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:30.840747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33983be5-c349-4869-b594-1f1dfa40eba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:30.842643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33983be5-c349-4869-b594-1f1dfa40eba8 service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:30.851790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1104/2234] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:07:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:07:32.301208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683493c2-c343-4f32-a15e-039ea265f807 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:32.372467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683493c2-c343-4f32-a15e-039ea265f807 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:32.377208 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:32.378117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:32.378397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:32.378675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] PATH_INFO: `/v3/users/3e4d4c6fab754c23b92d3dd8651cebf9` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:32.380531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4d4c6fab754c23b92d3dd8651cebf9)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:32.383979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:32.543389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4d4c6fab754c23b92d3dd8651cebf9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:32.619639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4d4c6fab754c23b92d3dd8651cebf9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:32.627671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4d4c6fab754c23b92d3dd8651cebf9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:32.632349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:32.642475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4d4c6fab754c23b92d3dd8651cebf9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:32.643112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4d4c6fab754c23b92d3dd8651cebf9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:32.649732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1131/2235] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:07:32 2022] DELETE /identity/v3/users/3e4d4c6fab754c23b92d3dd8651cebf9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:07:32.655386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9883c3-ec45-434a-ba62-31369e7b0111 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:32.655947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9883c3-ec45-434a-ba62-31369e7b0111 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:32.656060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9883c3-ec45-434a-ba62-31369e7b0111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:32.675326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-7b9883c3-ec45-434a-ba62-31369e7b0111 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:32.677153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7b9883c3-ec45-434a-ba62-31369e7b0111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:32.728433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:32.746267 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1105/2236] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:32.756188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:32.758511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:32.825217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f70614-ff48-41a3-8124-51e7750c4e2c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:32.829611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb22c4f-fd7c-4d35-8521-87479216d5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:32.830354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb22c4f-fd7c-4d35-8521-87479216d5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:32.831028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb22c4f-fd7c-4d35-8521-87479216d5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:32.832283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb22c4f-fd7c-4d35-8521-87479216d5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:32.847983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb22c4f-fd7c-4d35-8521-87479216d5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:32.849444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb22c4f-fd7c-4d35-8521-87479216d5e2 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:32.870409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1132/2237] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:33.587693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9883c3-ec45-434a-ba62-31369e7b0111 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:33.589415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7b9883c3-ec45-434a-ba62-31369e7b0111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:33.610181 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9883c3-ec45-434a-ba62-31369e7b0111 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:33.623833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:33.625612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:33.626439 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:33.626998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] PATH_INFO: `/v3/projects/d6b2851acd1e4ec687acc2fc8e6e2bb9` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:33.629887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b2851acd1e4ec687acc2fc8e6e2bb9)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:33.632392 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:34.227445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b2851acd1e4ec687acc2fc8e6e2bb9', 'request_id': 'req-32197754-e62a-4e30-8be2-aadb05adb03a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:34.236212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b2851acd1e4ec687acc2fc8e6e2bb9', 'request_id': 'req-32197754-e62a-4e30-8be2-aadb05adb03a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:34.246943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b2851acd1e4ec687acc2fc8e6e2bb9', 'request_id': 'req-32197754-e62a-4e30-8be2-aadb05adb03a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:34.362746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] The token cache is being invalidate because project d6b2851acd1e4ec687acc2fc8e6e2bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:07:34.369643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:34.369643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-32197754-e62a-4e30-8be2-aadb05adb03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:07:34.369643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1106/2238] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:07:33 2022] DELETE /identity/v3/projects/d6b2851acd1e4ec687acc2fc8e6e2bb9 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:07:34.371249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7147b-5462-499f-835d-5756545d006c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:34.371781 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7147b-5462-499f-835d-5756545d006c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:34.371868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7147b-5462-499f-835d-5756545d006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:34.400799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e3c7147b-5462-499f-835d-5756545d006c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:34.402060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e3c7147b-5462-499f-835d-5756545d006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:34.490676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1133/2239] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:34.500054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570db639-ae09-4f30-8553-075cf5a39d37 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:34.500278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570db639-ae09-4f30-8553-075cf5a39d37 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:34.500462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570db639-ae09-4f30-8553-075cf5a39d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:34.540851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-570db639-ae09-4f30-8553-075cf5a39d37 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:34.542255 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-570db639-ae09-4f30-8553-075cf5a39d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:34.555057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1107/2240] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:34.558947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7147b-5462-499f-835d-5756545d006c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:34.570589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7147b-5462-499f-835d-5756545d006c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:34.575875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6edc3-e408-494d-8f73-9c1efb75ec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:34.576607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6edc3-e408-494d-8f73-9c1efb75ec53 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:34.576912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6edc3-e408-494d-8f73-9c1efb75ec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:34.577235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6edc3-e408-494d-8f73-9c1efb75ec53 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:34.577975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6edc3-e408-494d-8f73-9c1efb75ec53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:07:34.578283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6edc3-e408-494d-8f73-9c1efb75ec53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:34.579957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6edc3-e408-494d-8f73-9c1efb75ec53 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:34.598411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1134/2241] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:07:34.599900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570db639-ae09-4f30-8553-075cf5a39d37 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:34.610612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570db639-ae09-4f30-8553-075cf5a39d37 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:34.620411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db4139-4087-457b-9e59-15928db43491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:34.621116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db4139-4087-457b-9e59-15928db43491 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:34.621400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db4139-4087-457b-9e59-15928db43491 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:34.621707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db4139-4087-457b-9e59-15928db43491 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:34.622375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db4139-4087-457b-9e59-15928db43491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:34.624366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db4139-4087-457b-9e59-15928db43491 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:34.752484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1108/2242] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:07:34 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:07:34.757640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6edc3-e408-494d-8f73-9c1efb75ec53 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:34.768435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6edc3-e408-494d-8f73-9c1efb75ec53 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:34.830006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd41179-626d-49d8-8e00-514b9923dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:34.830677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41179-626d-49d8-8e00-514b9923dba4 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:34.830958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41179-626d-49d8-8e00-514b9923dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:34.831229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41179-626d-49d8-8e00-514b9923dba4 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:34.832574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd41179-626d-49d8-8e00-514b9923dba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:34.834497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd41179-626d-49d8-8e00-514b9923dba4 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:34.969878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1135/2243] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:07:34 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:07:34.973980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db4139-4087-457b-9e59-15928db43491 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:34.986829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db4139-4087-457b-9e59-15928db43491 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:34.990693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c9090-7d44-4798-90bf-eda1e3e57ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:34.991453 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c9090-7d44-4798-90bf-eda1e3e57ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:34.991794 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c9090-7d44-4798-90bf-eda1e3e57ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:34.992062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c9090-7d44-4798-90bf-eda1e3e57ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:34.993168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c9090-7d44-4798-90bf-eda1e3e57ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:34.994785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c9090-7d44-4798-90bf-eda1e3e57ee1 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:35.013656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1109/2244] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:07:35.015228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd41179-626d-49d8-8e00-514b9923dba4 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:35.023705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:35.030876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd41179-626d-49d8-8e00-514b9923dba4 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:35.033444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81342624-3b5a-4576-8221-6ed4cd6e2ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:35.034764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81342624-3b5a-4576-8221-6ed4cd6e2ffa admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:35.034955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81342624-3b5a-4576-8221-6ed4cd6e2ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:35.035382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81342624-3b5a-4576-8221-6ed4cd6e2ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:35.036158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81342624-3b5a-4576-8221-6ed4cd6e2ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:35.037717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81342624-3b5a-4576-8221-6ed4cd6e2ffa admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:35.049419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1136/2245] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:07:35.053633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c9090-7d44-4798-90bf-eda1e3e57ee1 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:35.065728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c9090-7d44-4798-90bf-eda1e3e57ee1 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:35.070605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da224989-6332-48f7-b247-9b7bb68a94b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:35.071494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224989-6332-48f7-b247-9b7bb68a94b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:35.071977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224989-6332-48f7-b247-9b7bb68a94b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:35.072266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224989-6332-48f7-b247-9b7bb68a94b2 admin admin] PATH_INFO: `/v3/projects/31474d84c380464d8312ab335d7359a6/users/042d0ce221304bd58a6fa4bac2ba365b/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:35.091346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da224989-6332-48f7-b247-9b7bb68a94b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31474d84c380464d8312ab335d7359a6, user_id=042d0ce221304bd58a6fa4bac2ba365b, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:35.094433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da224989-6332-48f7-b247-9b7bb68a94b2 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:35.245034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1110/2246] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:07:35 2022] PUT /identity/v3/projects/31474d84c380464d8312ab335d7359a6/users/042d0ce221304bd58a6fa4bac2ba365b/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:07:35.250171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e05239-313d-4e02-b4cc-e77a507f2bb3 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:35.250477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e05239-313d-4e02-b4cc-e77a507f2bb3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:35.250757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e05239-313d-4e02-b4cc-e77a507f2bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:35.269822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d1e05239-313d-4e02-b4cc-e77a507f2bb3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:35.271026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d1e05239-313d-4e02-b4cc-e77a507f2bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:35.344754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1137/2247] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:35.354646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da224989-6332-48f7-b247-9b7bb68a94b2 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:35.356593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-da224989-6332-48f7-b247-9b7bb68a94b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:35.474020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da224989-6332-48f7-b247-9b7bb68a94b2 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:35.495634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5f96d-5c42-4d97-803f-ea317463dc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:35.496434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5f96d-5c42-4d97-803f-ea317463dc82 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:35.497735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5f96d-5c42-4d97-803f-ea317463dc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:35.497735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5f96d-5c42-4d97-803f-ea317463dc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:35.521756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5f96d-5c42-4d97-803f-ea317463dc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:35.523369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5f96d-5c42-4d97-803f-ea317463dc82 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:35.549971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1111/2248] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:37.054667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ef60a-390c-461a-bb1f-7c75bcc1634e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:37.055244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ef60a-390c-461a-bb1f-7c75bcc1634e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:37.056142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ef60a-390c-461a-bb1f-7c75bcc1634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:37.118115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-027ef60a-390c-461a-bb1f-7c75bcc1634e None None] MFA Rules not processed for user `042d0ce221304bd58a6fa4bac2ba365b`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:37.120435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-027ef60a-390c-461a-bb1f-7c75bcc1634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:37.223950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1138/2249] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:37.234945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5f96d-5c42-4d97-803f-ea317463dc82 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:37.236382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b7d5f96d-5c42-4d97-803f-ea317463dc82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:37.249057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:37.298005 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5f96d-5c42-4d97-803f-ea317463dc82 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:37.302400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347971b-8743-476c-b29f-bbb8d46c2c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:37.303046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347971b-8743-476c-b29f-bbb8d46c2c66 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:37.303327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347971b-8743-476c-b29f-bbb8d46c2c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:37.303627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347971b-8743-476c-b29f-bbb8d46c2c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:37.312988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347971b-8743-476c-b29f-bbb8d46c2c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:37.314639 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347971b-8743-476c-b29f-bbb8d46c2c66 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:37.326575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1112/2250] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:07:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:39.151251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb859-91b2-40be-9044-b3a85c99da75 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:39.151908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb859-91b2-40be-9044-b3a85c99da75 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:39.151908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb859-91b2-40be-9044-b3a85c99da75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:39.176995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-7d4eb859-91b2-40be-9044-b3a85c99da75 None None] MFA Rules not processed for user `042d0ce221304bd58a6fa4bac2ba365b`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:39.178214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7d4eb859-91b2-40be-9044-b3a85c99da75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:39.185364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1139/2251] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:07:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:07:41.245614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347971b-8743-476c-b29f-bbb8d46c2c66 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:41.247234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f347971b-8743-476c-b29f-bbb8d46c2c66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:41.327513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347971b-8743-476c-b29f-bbb8d46c2c66 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:41.332635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:41.333268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:41.333547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:41.333819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:41.335623 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:41.347218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:41.348855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:41.358590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1113/2252] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:07:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:07:46.397646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9ba3-34eb-4081-937e-223944d0d2ef None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:46.398150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9ba3-34eb-4081-937e-223944d0d2ef None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:46.398249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9ba3-34eb-4081-937e-223944d0d2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:46.416345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f6de9ba3-34eb-4081-937e-223944d0d2ef None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:07:46.417842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f6de9ba3-34eb-4081-937e-223944d0d2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:46.487846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1140/2253] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:07:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:07:46.513096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:07:46.513872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:07:46.593560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0168bbe-64c2-44bb-b75d-077cf957f403 service placement] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:07:46.599256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31039d32-cb5c-4f47-98e3-d7c640819356 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:07:46.599934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31039d32-cb5c-4f47-98e3-d7c640819356 service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:07:46.600213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31039d32-cb5c-4f47-98e3-d7c640819356 service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:07:46.600502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31039d32-cb5c-4f47-98e3-d7c640819356 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:07:46.609999 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31039d32-cb5c-4f47-98e3-d7c640819356 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:07:46.611650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31039d32-cb5c-4f47-98e3-d7c640819356 service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:07:46.623176 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1114/2254] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:07:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:07:56.476717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=90 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:07:56.619046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=86 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:00.305499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c18e-fc06-43f6-b88c-f915108a9a87 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:00.306012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c18e-fc06-43f6-b88c-f915108a9a87 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:00.306927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c18e-fc06-43f6-b88c-f915108a9a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:00.328578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-96d7c18e-fc06-43f6-b88c-f915108a9a87 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:00.329881 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-96d7c18e-fc06-43f6-b88c-f915108a9a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:00.337886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1141/2255] 10.222.0.93 () {58 vars in 967 bytes} [Thu May 26 17:08:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:08:00.351446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31039d32-cb5c-4f47-98e3-d7c640819356 service swift] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:00.362444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31039d32-cb5c-4f47-98e3-d7c640819356 service swift] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:00.368662 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fcdda-bb3f-4574-8b12-69c513fa6394 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:00.369502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fcdda-bb3f-4574-8b12-69c513fa6394 service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:00.369785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fcdda-bb3f-4574-8b12-69c513fa6394 service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:00.370062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fcdda-bb3f-4574-8b12-69c513fa6394 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:00.379159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fcdda-bb3f-4574-8b12-69c513fa6394 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:00.380907 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fcdda-bb3f-4574-8b12-69c513fa6394 service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:00.390033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1115/2256] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:08:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:08:04.625642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7485c1-5d6a-4b1d-baea-1f3bdd07e575 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:04.626180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7485c1-5d6a-4b1d-baea-1f3bdd07e575 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:04.626311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7485c1-5d6a-4b1d-baea-1f3bdd07e575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:04.647315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-cc7485c1-5d6a-4b1d-baea-1f3bdd07e575 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:04.653844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-cc7485c1-5d6a-4b1d-baea-1f3bdd07e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:04.656430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1142/2257] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:08:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:04.668798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fcdda-bb3f-4574-8b12-69c513fa6394 service swift] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:04.680645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fcdda-bb3f-4574-8b12-69c513fa6394 service swift] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:04.685807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a649d3-31db-4a0f-bbc0-67fa2809442d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:04.686469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a649d3-31db-4a0f-bbc0-67fa2809442d service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:04.686777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a649d3-31db-4a0f-bbc0-67fa2809442d service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:04.687051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a649d3-31db-4a0f-bbc0-67fa2809442d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:04.696290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a649d3-31db-4a0f-bbc0-67fa2809442d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:04.697909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a649d3-31db-4a0f-bbc0-67fa2809442d service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:04.705893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1116/2258] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:08:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:08:14.639736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=6 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:14.703055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=12 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:23.410292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7485c1-5d6a-4b1d-baea-1f3bdd07e575 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:23.412139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-cc7485c1-5d6a-4b1d-baea-1f3bdd07e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:23.427604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7485c1-5d6a-4b1d-baea-1f3bdd07e575 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:23.432115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4939-cf7a-42fe-a433-b1cc4faa6cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:23.433000 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4939-cf7a-42fe-a433-b1cc4faa6cda service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:23.433286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4939-cf7a-42fe-a433-b1cc4faa6cda service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:23.433562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4939-cf7a-42fe-a433-b1cc4faa6cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:23.435525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-81cf4939-cf7a-42fe-a433-b1cc4faa6cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:23.523352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4939-cf7a-42fe-a433-b1cc4faa6cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:23.524769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4939-cf7a-42fe-a433-b1cc4faa6cda service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:23.535481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1143/2259] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:29.638727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f292e-f5b7-43bd-b27d-fe4fa947524c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:29.639504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f292e-f5b7-43bd-b27d-fe4fa947524c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:29.639504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f292e-f5b7-43bd-b27d-fe4fa947524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:29.659106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-746f292e-f5b7-43bd-b27d-fe4fa947524c None None] MFA Rules not processed for user `62b8c8b994e54023933a4ff2ecf68f42`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:29.660832 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-746f292e-f5b7-43bd-b27d-fe4fa947524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:29.742027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1117/2260] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:08:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:30.029336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4740-d9da-4e07-b4fb-68b19d586713 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:30.029858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4740-d9da-4e07-b4fb-68b19d586713 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:30.029952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4740-d9da-4e07-b4fb-68b19d586713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:30.051461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3aee4740-d9da-4e07-b4fb-68b19d586713 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:30.053307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3aee4740-d9da-4e07-b4fb-68b19d586713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:30.062519 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1144/2261] 10.222.0.93 () {58 vars in 967 bytes} [Thu May 26 17:08:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:30.076962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f292e-f5b7-43bd-b27d-fe4fa947524c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:30.088929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f292e-f5b7-43bd-b27d-fe4fa947524c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:30.094644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0034be5-85d3-40f9-ba10-1fd3f6da67ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:30.095315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0034be5-85d3-40f9-ba10-1fd3f6da67ed service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:30.095638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0034be5-85d3-40f9-ba10-1fd3f6da67ed service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:30.095923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0034be5-85d3-40f9-ba10-1fd3f6da67ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:30.106647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0034be5-85d3-40f9-ba10-1fd3f6da67ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:30.108336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0034be5-85d3-40f9-ba10-1fd3f6da67ed service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:30.118188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1118/2262] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:08:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:08:33.914865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4740-d9da-4e07-b4fb-68b19d586713 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:33.916516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3aee4740-d9da-4e07-b4fb-68b19d586713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:33.944319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4740-d9da-4e07-b4fb-68b19d586713 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:33.945028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:33.946510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:33.946758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:33.947615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] PATH_INFO: `/v3/users/1fb0244aad5e4e73a43f04681ed6860b` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:33.948918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb0244aad5e4e73a43f04681ed6860b)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:33.954303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:34.197987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb0244aad5e4e73a43f04681ed6860b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.264329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb0244aad5e4e73a43f04681ed6860b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.272001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb0244aad5e4e73a43f04681ed6860b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.283982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb0244aad5e4e73a43f04681ed6860b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.285206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb0244aad5e4e73a43f04681ed6860b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.291303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1145/2263] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:08:33 2022] DELETE /identity/v3/users/1fb0244aad5e4e73a43f04681ed6860b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:08:34.604434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79568f7-3f08-4bfb-87dd-438dfe3915d5 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:34.604958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79568f7-3f08-4bfb-87dd-438dfe3915d5 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:34.605084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79568f7-3f08-4bfb-87dd-438dfe3915d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:34.623159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e79568f7-3f08-4bfb-87dd-438dfe3915d5 None None] MFA Rules not processed for user `f4794216544c4b969910eb48c2769f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:34.624450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e79568f7-3f08-4bfb-87dd-438dfe3915d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:34.672473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:34.674112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:34.694188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1119/2264] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:08:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:34.790537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6abb3-b15e-4889-80f0-cd4f58e3a373 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:34.797234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:34.797689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:34.797979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:34.798261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] PATH_INFO: `/v3/projects/41e96a709a06474c95233d864c1ff139` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:34.799491 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e96a709a06474c95233d864c1ff139)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:34.801650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:34.803540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:34.981242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e96a709a06474c95233d864c1ff139', 'request_id': 'req-c967149f-1b45-47ff-a1b0-436bbf33b24e'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.988878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e96a709a06474c95233d864c1ff139', 'request_id': 'req-c967149f-1b45-47ff-a1b0-436bbf33b24e'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:34.994980 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e96a709a06474c95233d864c1ff139', 'request_id': 'req-c967149f-1b45-47ff-a1b0-436bbf33b24e'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:35.057449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] The token cache is being invalidate because project 41e96a709a06474c95233d864c1ff139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:08:35.057744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:35.058399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:08:35.060123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1146/2265] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:08:34 2022] DELETE /identity/v3/projects/41e96a709a06474c95233d864c1ff139 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:08:44.681781 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=56 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:45.449672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2337fbb-b513-4331-964d-9baf1c37736d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:45.449956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2337fbb-b513-4331-964d-9baf1c37736d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:45.450231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2337fbb-b513-4331-964d-9baf1c37736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:45.458854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:08:45.468858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a2337fbb-b513-4331-964d-9baf1c37736d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:45.470037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a2337fbb-b513-4331-964d-9baf1c37736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:45.529803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1120/2266] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:45.555281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:45.556656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:45.633533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967149f-1b45-47ff-a1b0-436bbf33b24e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:45.639331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1116-9e6e-47da-a0c4-2f17f01e3d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:45.640017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1116-9e6e-47da-a0c4-2f17f01e3d7e service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:45.640295 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1116-9e6e-47da-a0c4-2f17f01e3d7e service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:45.640569 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1116-9e6e-47da-a0c4-2f17f01e3d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:45.650311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c1116-9e6e-47da-a0c4-2f17f01e3d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:45.651943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c1116-9e6e-47da-a0c4-2f17f01e3d7e service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:45.662046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1147/2267] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:50.968876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92397ec-d0d8-4f4b-b837-7bcae1565d4d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:50.969457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92397ec-d0d8-4f4b-b837-7bcae1565d4d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:50.969457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92397ec-d0d8-4f4b-b837-7bcae1565d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:50.988342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-b92397ec-d0d8-4f4b-b837-7bcae1565d4d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:50.990234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b92397ec-d0d8-4f4b-b837-7bcae1565d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:50.998494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1121/2268] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:51.022033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1116-9e6e-47da-a0c4-2f17f01e3d7e service nova] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:51.035225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1116-9e6e-47da-a0c4-2f17f01e3d7e service nova] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:51.041621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67b04e-cc00-489c-bb36-5e10b36ea42b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:51.042265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67b04e-cc00-489c-bb36-5e10b36ea42b service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:51.042652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67b04e-cc00-489c-bb36-5e10b36ea42b service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:51.042816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67b04e-cc00-489c-bb36-5e10b36ea42b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:51.052340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67b04e-cc00-489c-bb36-5e10b36ea42b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:51.053975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67b04e-cc00-489c-bb36-5e10b36ea42b service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:51.064619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1148/2269] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:08:56.616996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dfdfa-4a88-4645-bac1-63e0369a45d7 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:56.617594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dfdfa-4a88-4645-bac1-63e0369a45d7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:56.617594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dfdfa-4a88-4645-bac1-63e0369a45d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:56.636887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-908dfdfa-4a88-4645-bac1-63e0369a45d7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:08:56.638076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-908dfdfa-4a88-4645-bac1-63e0369a45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:08:56.646479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1122/2270] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:08:56.673115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67b04e-cc00-489c-bb36-5e10b36ea42b service nova] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:08:56.684376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67b04e-cc00-489c-bb36-5e10b36ea42b service nova] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:08:56.689962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428932e7-fe50-4d9a-887c-7ffda0bf36d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:08:56.690591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428932e7-fe50-4d9a-887c-7ffda0bf36d9 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:08:56.690868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428932e7-fe50-4d9a-887c-7ffda0bf36d9 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:08:56.691139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428932e7-fe50-4d9a-887c-7ffda0bf36d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:08:56.699780 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428932e7-fe50-4d9a-887c-7ffda0bf36d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:08:56.701344 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428932e7-fe50-4d9a-887c-7ffda0bf36d9 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:08:56.711614 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1149/2271] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:01.517292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f814a7-1726-4b7e-8157-4d309565e769 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:01.517853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f814a7-1726-4b7e-8157-4d309565e769 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:01.517853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f814a7-1726-4b7e-8157-4d309565e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:01.541708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e9f814a7-1726-4b7e-8157-4d309565e769 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:09:01.543419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e9f814a7-1726-4b7e-8157-4d309565e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:01.553056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1123/2272] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:09:01.581529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428932e7-fe50-4d9a-887c-7ffda0bf36d9 service nova] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:01.584459 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-428932e7-fe50-4d9a-887c-7ffda0bf36d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:01.601289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428932e7-fe50-4d9a-887c-7ffda0bf36d9 service nova] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:01.607155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f2702-cc6c-4377-b0eb-df2ffc87ef55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:01.607893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f2702-cc6c-4377-b0eb-df2ffc87ef55 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:01.608175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f2702-cc6c-4377-b0eb-df2ffc87ef55 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:01.608447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f2702-cc6c-4377-b0eb-df2ffc87ef55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:01.618129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f2702-cc6c-4377-b0eb-df2ffc87ef55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:01.619451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f2702-cc6c-4377-b0eb-df2ffc87ef55 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:01.630552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1150/2273] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:05.964278 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d1bc-eb57-4b69-8147-bad6eb02e7a3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:05.965116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d1bc-eb57-4b69-8147-bad6eb02e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:05.965302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d1bc-eb57-4b69-8147-bad6eb02e7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:05.988550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-6751d1bc-eb57-4b69-8147-bad6eb02e7a3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:09:05.989903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6751d1bc-eb57-4b69-8147-bad6eb02e7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:05.999334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1124/2274] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:09:06.028195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f2702-cc6c-4377-b0eb-df2ffc87ef55 service nova] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:06.040091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f2702-cc6c-4377-b0eb-df2ffc87ef55 service nova] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:06.045809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dc18d-4133-40fe-b9dc-2bfdeb622279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:06.046452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc18d-4133-40fe-b9dc-2bfdeb622279 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:06.046739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc18d-4133-40fe-b9dc-2bfdeb622279 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:06.047067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc18d-4133-40fe-b9dc-2bfdeb622279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:06.055811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dc18d-4133-40fe-b9dc-2bfdeb622279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:06.057416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dc18d-4133-40fe-b9dc-2bfdeb622279 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:06.069077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1151/2275] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:08.980346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5677-914d-4658-9571-b74add21d2e3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:08.981626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5677-914d-4658-9571-b74add21d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:08.985114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5677-914d-4658-9571-b74add21d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:09.000190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-7bbe5677-914d-4658-9571-b74add21d2e3 None None] MFA Rules not processed for user `bc0e583fb8414bde82872ccc4726e5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:09:09.001379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7bbe5677-914d-4658-9571-b74add21d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:09.055824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1125/2276] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:09:10.195955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e2bf-3faa-4303-9133-f2f8bc758b89 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:10.196448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e2bf-3faa-4303-9133-f2f8bc758b89 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:10.196580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e2bf-3faa-4303-9133-f2f8bc758b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:10.215312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e716e2bf-3faa-4303-9133-f2f8bc758b89 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:09:10.216597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e716e2bf-3faa-4303-9133-f2f8bc758b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:10.224831 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1152/2277] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:09:10.256470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5677-914d-4658-9571-b74add21d2e3 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:10.269386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5677-914d-4658-9571-b74add21d2e3 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:10.314705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b921d65-afcf-4283-9f9e-74982bc3b905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:10.314705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b921d65-afcf-4283-9f9e-74982bc3b905 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:10.314705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b921d65-afcf-4283-9f9e-74982bc3b905 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:10.314705 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b921d65-afcf-4283-9f9e-74982bc3b905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:10.316002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b921d65-afcf-4283-9f9e-74982bc3b905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:10.316002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b921d65-afcf-4283-9f9e-74982bc3b905 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:10.316002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1126/2278] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:20.210128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=61 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:20.292350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=70 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:30.457348 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e2bf-3faa-4303-9133-f2f8bc758b89 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:30.459027 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e716e2bf-3faa-4303-9133-f2f8bc758b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:30.516882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e2bf-3faa-4303-9133-f2f8bc758b89 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:30.520526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:30.521195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:30.521475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:30.521745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:30.523540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:30.537783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:30.539387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:30.552088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1153/2279] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:09:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:32.778076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba2aa-25e3-4c3a-9f62-4be8ee6dbcf5 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:32.778672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba2aa-25e3-4c3a-9f62-4be8ee6dbcf5 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:32.778672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba2aa-25e3-4c3a-9f62-4be8ee6dbcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:32.798104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c28ba2aa-25e3-4c3a-9f62-4be8ee6dbcf5 None None] MFA Rules not processed for user `7f8a3035f5c54f3d84e2a81240a9306f`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:09:32.799609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c28ba2aa-25e3-4c3a-9f62-4be8ee6dbcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:32.857665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1127/2280] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:09:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:09:33.600372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:33.604750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:33.677382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712cb49-c859-40a0-964a-7324df29acc5 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:33.681488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d881a78-74c5-4b6e-a2a6-2b8d6e5f053d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:33.682275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881a78-74c5-4b6e-a2a6-2b8d6e5f053d service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:33.682681 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881a78-74c5-4b6e-a2a6-2b8d6e5f053d service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:33.683207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881a78-74c5-4b6e-a2a6-2b8d6e5f053d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:33.685336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3d881a78-74c5-4b6e-a2a6-2b8d6e5f053d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:33.705806 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d881a78-74c5-4b6e-a2a6-2b8d6e5f053d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:33.709359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d881a78-74c5-4b6e-a2a6-2b8d6e5f053d service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:33.724968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1154/2281] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:33.976805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6080a4-c53d-41c3-bebb-7fe362ed7ba4 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:33.977668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6080a4-c53d-41c3-bebb-7fe362ed7ba4 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:33.978200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6080a4-c53d-41c3-bebb-7fe362ed7ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:33.996734 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-7f6080a4-c53d-41c3-bebb-7fe362ed7ba4 None None] MFA Rules not processed for user `042d0ce221304bd58a6fa4bac2ba365b`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:09:33.998090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7f6080a4-c53d-41c3-bebb-7fe362ed7ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:34.078716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1128/2282] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:09:43.718290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=52 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:44.072087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=50 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:09:47.655365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d881a78-74c5-4b6e-a2a6-2b8d6e5f053d service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:47.664094 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d881a78-74c5-4b6e-a2a6-2b8d6e5f053d service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:47.667759 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:47.668386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:47.668670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:47.668948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:47.670834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:47.682343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:47.683745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:47.693354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1155/2283] 10.222.0.93 () {60 vars in 1396 bytes} [Thu May 26 17:09:47 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3238 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:50.734978 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6080a4-c53d-41c3-bebb-7fe362ed7ba4 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:50.751422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6080a4-c53d-41c3-bebb-7fe362ed7ba4 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:50.757182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886a7a-3633-42e9-a907-23b55a533c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:50.757831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886a7a-3633-42e9-a907-23b55a533c33 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:50.758166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886a7a-3633-42e9-a907-23b55a533c33 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:50.758442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886a7a-3633-42e9-a907-23b55a533c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:50.760370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1b886a7a-3633-42e9-a907-23b55a533c33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:50.821833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b886a7a-3633-42e9-a907-23b55a533c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:50.823474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b886a7a-3633-42e9-a907-23b55a533c33 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:50.833432 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1129/2284] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:09:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:53.674040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:53.677667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:53.699047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3d6d0-7530-4b96-a913-cf4bbf1b9f0d service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:53.704842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f175e-5128-40bb-93a9-1807df10003e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:53.705883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f175e-5128-40bb-93a9-1807df10003e service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:53.706454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f175e-5128-40bb-93a9-1807df10003e service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:53.707521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f175e-5128-40bb-93a9-1807df10003e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:53.710085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6c0f175e-5128-40bb-93a9-1807df10003e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:53.726085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f175e-5128-40bb-93a9-1807df10003e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:53.728938 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f175e-5128-40bb-93a9-1807df10003e service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:53.739016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1156/2285] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:09:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:57.769990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886a7a-3633-42e9-a907-23b55a533c33 service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:57.781566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886a7a-3633-42e9-a907-23b55a533c33 service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:57.787876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1f83e-8e5c-4c10-8bca-df7e291451c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:57.788521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1f83e-8e5c-4c10-8bca-df7e291451c1 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:57.788801 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1f83e-8e5c-4c10-8bca-df7e291451c1 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:57.789080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1f83e-8e5c-4c10-8bca-df7e291451c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:57.790863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6dc1f83e-8e5c-4c10-8bca-df7e291451c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:57.851035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1f83e-8e5c-4c10-8bca-df7e291451c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:57.852684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1f83e-8e5c-4c10-8bca-df7e291451c1 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:57.861533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1130/2286] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:09:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:09:59.948686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f175e-5128-40bb-93a9-1807df10003e service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:09:59.962542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f175e-5128-40bb-93a9-1807df10003e service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:09:59.968583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d650b-f78f-4938-88cf-27f8bb21ad1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:09:59.969224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d650b-f78f-4938-88cf-27f8bb21ad1a service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:09:59.969789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d650b-f78f-4938-88cf-27f8bb21ad1a service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:09:59.970064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d650b-f78f-4938-88cf-27f8bb21ad1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:09:59.972438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-371d650b-f78f-4938-88cf-27f8bb21ad1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:09:59.985754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d650b-f78f-4938-88cf-27f8bb21ad1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:09:59.987447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d650b-f78f-4938-88cf-27f8bb21ad1a service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:09:59.998558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1157/2287] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:09:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:02.325724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1f83e-8e5c-4c10-8bca-df7e291451c1 service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:02.335669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1f83e-8e5c-4c10-8bca-df7e291451c1 service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:02.339408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8988d-377c-4292-9f8d-40e2ccbb909f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:02.340078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8988d-377c-4292-9f8d-40e2ccbb909f service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:02.340362 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8988d-377c-4292-9f8d-40e2ccbb909f service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:02.340633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8988d-377c-4292-9f8d-40e2ccbb909f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:02.342873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8cb8988d-377c-4292-9f8d-40e2ccbb909f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:02.356055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8988d-377c-4292-9f8d-40e2ccbb909f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:02.357476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8988d-377c-4292-9f8d-40e2ccbb909f service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:02.367425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1131/2288] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:03.210624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1212c-7779-43fe-b4ac-3d50ffaf0fe5 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:03.211158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1212c-7779-43fe-b4ac-3d50ffaf0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:03.211158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1212c-7779-43fe-b4ac-3d50ffaf0fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:03.233844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-bdf1212c-7779-43fe-b4ac-3d50ffaf0fe5 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:03.235050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bdf1212c-7779-43fe-b4ac-3d50ffaf0fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:03.243763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1158/2289] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:03.279494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8988d-377c-4292-9f8d-40e2ccbb909f service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:03.292324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8988d-377c-4292-9f8d-40e2ccbb909f service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:03.297922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7077b5-9162-4905-8918-96298e79f0a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:03.298565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7077b5-9162-4905-8918-96298e79f0a2 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:03.298848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7077b5-9162-4905-8918-96298e79f0a2 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:03.299132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7077b5-9162-4905-8918-96298e79f0a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:03.308568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7077b5-9162-4905-8918-96298e79f0a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:03.310151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7077b5-9162-4905-8918-96298e79f0a2 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:03.320576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1132/2290] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:04.835115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481685b-69ee-4585-9b7a-8499167f005c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:04.835703 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481685b-69ee-4585-9b7a-8499167f005c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:04.835925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481685b-69ee-4585-9b7a-8499167f005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:04.853838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b481685b-69ee-4585-9b7a-8499167f005c None None] MFA Rules not processed for user `62b8c8b994e54023933a4ff2ecf68f42`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:04.855028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b481685b-69ee-4585-9b7a-8499167f005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:04.862242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1159/2291] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:05.209408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7077b5-9162-4905-8918-96298e79f0a2 service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:05.219508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7077b5-9162-4905-8918-96298e79f0a2 service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:05.225285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:05.226009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:05.226463 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:05.227355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:05.229659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:05.241187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:05.242642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:05.251828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1133/2292] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:05.724925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481685b-69ee-4585-9b7a-8499167f005c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:05.727133 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b481685b-69ee-4585-9b7a-8499167f005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:05.916495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481685b-69ee-4585-9b7a-8499167f005c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:05.922601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a64cb-45fe-47e5-804d-bf6e9b364110 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:05.923525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a64cb-45fe-47e5-804d-bf6e9b364110 service placement] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:05.923842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a64cb-45fe-47e5-804d-bf6e9b364110 service placement] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:05.924327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a64cb-45fe-47e5-804d-bf6e9b364110 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:05.927263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5b5a64cb-45fe-47e5-804d-bf6e9b364110 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:05.954385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a64cb-45fe-47e5-804d-bf6e9b364110 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:05.956678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a64cb-45fe-47e5-804d-bf6e9b364110 service placement] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:05.967924 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1160/2293] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:06.843354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:06.843354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:06.843354 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d22216-bca6-4bef-b6d1-3581c06fb224 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:06.844757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:06.844757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:06.844757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:06.844757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] PATH_INFO: `/v3/users/f4794216544c4b969910eb48c2769f3a` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:06.845288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4794216544c4b969910eb48c2769f3a)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:06.846893 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:07.173639 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4794216544c4b969910eb48c2769f3a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.179212 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:07.184353 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4794216544c4b969910eb48c2769f3a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.185097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4794216544c4b969910eb48c2769f3a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.198220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4794216544c4b969910eb48c2769f3a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.198930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4794216544c4b969910eb48c2769f3a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.278472 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ca441-bdae-439b-8ed6-1f341fe7a9b2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:07.279005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ca441-bdae-439b-8ed6-1f341fe7a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:07.279005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ca441-bdae-439b-8ed6-1f341fe7a9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:07.299269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-8c1ca441-bdae-439b-8ed6-1f341fe7a9b2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:07.300772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8c1ca441-bdae-439b-8ed6-1f341fe7a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:07.313838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1134/2294] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:10:06 2022] DELETE /identity/v3/users/f4794216544c4b969910eb48c2769f3a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:07.321605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1161/2295] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:10:07.346281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:07.348251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:07.427810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a9cd-55f1-4228-b243-ca9b863defcb admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:07.435213 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202814-f1cc-423f-ae32-f10815f25fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:07.435548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202814-f1cc-423f-ae32-f10815f25fa6 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:07.436090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202814-f1cc-423f-ae32-f10815f25fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:07.436217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202814-f1cc-423f-ae32-f10815f25fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:07.512145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67202814-f1cc-423f-ae32-f10815f25fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:07.514471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67202814-f1cc-423f-ae32-f10815f25fa6 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:07.524462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1135/2296] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:10:07.573556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ca441-bdae-439b-8ed6-1f341fe7a9b2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:07.575388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8c1ca441-bdae-439b-8ed6-1f341fe7a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:07.588846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ca441-bdae-439b-8ed6-1f341fe7a9b2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:07.594323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:07.595446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:07.595976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:07.596542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] PATH_INFO: `/v3/projects/33a805ff6bbb4403b077283546b43297` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:07.606236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a805ff6bbb4403b077283546b43297)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:07.608649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:07.750716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a805ff6bbb4403b077283546b43297', 'request_id': 'req-842f0661-61cb-46ab-ae5c-edbea3e03c1b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.757784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a805ff6bbb4403b077283546b43297', 'request_id': 'req-842f0661-61cb-46ab-ae5c-edbea3e03c1b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.763443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a805ff6bbb4403b077283546b43297', 'request_id': 'req-842f0661-61cb-46ab-ae5c-edbea3e03c1b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.846389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] The token cache is being invalidate because project 33a805ff6bbb4403b077283546b43297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:10:07.846653 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.847298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-842f0661-61cb-46ab-ae5c-edbea3e03c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:07.848864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1162/2297] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:10:07 2022] DELETE /identity/v3/projects/33a805ff6bbb4403b077283546b43297 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:07.853956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751fddc-f099-4e63-8f63-13c7a963b5e3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:07.855848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751fddc-f099-4e63-8f63-13c7a963b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:07.855848 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751fddc-f099-4e63-8f63-13c7a963b5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:07.873854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8751fddc-f099-4e63-8f63-13c7a963b5e3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:07.875372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8751fddc-f099-4e63-8f63-13c7a963b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:07.934866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1136/2298] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:07.943010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec054-4898-4118-8056-705c1729a2bf None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:07.943294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec054-4898-4118-8056-705c1729a2bf None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:07.943584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec054-4898-4118-8056-705c1729a2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:07.962932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-8cdec054-4898-4118-8056-705c1729a2bf None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:07.964214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8cdec054-4898-4118-8056-705c1729a2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:07.972973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1163/2299] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:07.977207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751fddc-f099-4e63-8f63-13c7a963b5e3 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:07.982161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:07.988214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751fddc-f099-4e63-8f63-13c7a963b5e3 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:07.993089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae7e29-b26f-4bc5-8ad4-5f8029d3e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:07.997948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae7e29-b26f-4bc5-8ad4-5f8029d3e380 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:07.997948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae7e29-b26f-4bc5-8ad4-5f8029d3e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:07.997948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae7e29-b26f-4bc5-8ad4-5f8029d3e380 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:07.997948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae7e29-b26f-4bc5-8ad4-5f8029d3e380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:10:07.997948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae7e29-b26f-4bc5-8ad4-5f8029d3e380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:07.997948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae7e29-b26f-4bc5-8ad4-5f8029d3e380 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:08.010000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1137/2300] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:10:08.014552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdec054-4898-4118-8056-705c1729a2bf None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:08.026099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdec054-4898-4118-8056-705c1729a2bf None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:08.032454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9532-23fe-47a3-aad1-cdd2093a3e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:08.032454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9532-23fe-47a3-aad1-cdd2093a3e8d admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:08.032454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9532-23fe-47a3-aad1-cdd2093a3e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:08.032727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9532-23fe-47a3-aad1-cdd2093a3e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:08.033908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce9532-23fe-47a3-aad1-cdd2093a3e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:08.036045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce9532-23fe-47a3-aad1-cdd2093a3e8d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:08.039971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:08.171089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1164/2301] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:10:08 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:10:08.175118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae7e29-b26f-4bc5-8ad4-5f8029d3e380 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:08.185155 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae7e29-b26f-4bc5-8ad4-5f8029d3e380 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:08.241603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e69d7-f6c3-4a7a-aa2c-58cad2b0ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:08.242301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e69d7-f6c3-4a7a-aa2c-58cad2b0ca3d admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:08.242581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e69d7-f6c3-4a7a-aa2c-58cad2b0ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:08.242855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e69d7-f6c3-4a7a-aa2c-58cad2b0ca3d admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:08.243534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e69d7-f6c3-4a7a-aa2c-58cad2b0ca3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:08.245536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e69d7-f6c3-4a7a-aa2c-58cad2b0ca3d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:08.343412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1138/2302] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:10:08 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:08.348203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9532-23fe-47a3-aad1-cdd2093a3e8d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:08.359374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9532-23fe-47a3-aad1-cdd2093a3e8d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:08.364474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf35be-99c7-42f3-a210-77e620423941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:08.365126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf35be-99c7-42f3-a210-77e620423941 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:08.365408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf35be-99c7-42f3-a210-77e620423941 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:08.365688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf35be-99c7-42f3-a210-77e620423941 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:08.366431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf35be-99c7-42f3-a210-77e620423941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:08.368126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf35be-99c7-42f3-a210-77e620423941 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:08.379069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1165/2303] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:08.383205 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e69d7-f6c3-4a7a-aa2c-58cad2b0ca3d admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:08.393843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e69d7-f6c3-4a7a-aa2c-58cad2b0ca3d admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:08.398462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fab93-7923-48a5-aa1b-a83f0dcb6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:08.400037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fab93-7923-48a5-aa1b-a83f0dcb6749 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:08.400037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fab93-7923-48a5-aa1b-a83f0dcb6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:08.400037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fab93-7923-48a5-aa1b-a83f0dcb6749 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:08.400487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fab93-7923-48a5-aa1b-a83f0dcb6749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:08.402102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fab93-7923-48a5-aa1b-a83f0dcb6749 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:08.413056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1139/2304] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:08.417314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf35be-99c7-42f3-a210-77e620423941 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:08.436358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf35be-99c7-42f3-a210-77e620423941 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:08.436358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27acbb-0e95-4adf-ba6f-c4a78cbdc3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:08.436358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27acbb-0e95-4adf-ba6f-c4a78cbdc3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:08.436358 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27acbb-0e95-4adf-ba6f-c4a78cbdc3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:08.436822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27acbb-0e95-4adf-ba6f-c4a78cbdc3b3 admin admin] PATH_INFO: `/v3/projects/e2dc0266135948368cf75d622050939a/users/61550eb9f7f44ceaa05c308df9a99613/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:08.449220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27acbb-0e95-4adf-ba6f-c4a78cbdc3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dc0266135948368cf75d622050939a, user_id=61550eb9f7f44ceaa05c308df9a99613, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:08.451930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27acbb-0e95-4adf-ba6f-c4a78cbdc3b3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:08.610509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1166/2305] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:10:08 2022] PUT /identity/v3/projects/e2dc0266135948368cf75d622050939a/users/61550eb9f7f44ceaa05c308df9a99613/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:08.621053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f1b8-5275-4e5f-943d-fcd1c00247f4 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:08.621491 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f1b8-5275-4e5f-943d-fcd1c00247f4 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:08.622011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f1b8-5275-4e5f-943d-fcd1c00247f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:08.650905 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3fa8f1b8-5275-4e5f-943d-fcd1c00247f4 None None] MFA Rules not processed for user `61550eb9f7f44ceaa05c308df9a99613`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:08.652190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3fa8f1b8-5275-4e5f-943d-fcd1c00247f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:08.720192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1140/2306] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:10:08.731607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27acbb-0e95-4adf-ba6f-c4a78cbdc3b3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:08.733438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ab27acbb-0e95-4adf-ba6f-c4a78cbdc3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:08.807404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27acbb-0e95-4adf-ba6f-c4a78cbdc3b3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:08.812972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af19ca-8425-4881-ac68-55fb8d038e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:08.813616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af19ca-8425-4881-ac68-55fb8d038e8e service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:08.813896 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af19ca-8425-4881-ac68-55fb8d038e8e service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:08.814172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af19ca-8425-4881-ac68-55fb8d038e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:08.822547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af19ca-8425-4881-ac68-55fb8d038e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:08.824170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af19ca-8425-4881-ac68-55fb8d038e8e service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:08.833575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1167/2307] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:11.623337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4dff4-90c0-44a3-a98f-30732449d746 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:11.623938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4dff4-90c0-44a3-a98f-30732449d746 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:11.624077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4dff4-90c0-44a3-a98f-30732449d746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:11.648276 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-6ec4dff4-90c0-44a3-a98f-30732449d746 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:11.649551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6ec4dff4-90c0-44a3-a98f-30732449d746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:11.724690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:11.733837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1141/2308] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:11.756264 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af19ca-8425-4881-ac68-55fb8d038e8e service nova] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:11.757695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f6af19ca-8425-4881-ac68-55fb8d038e8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:11.772814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af19ca-8425-4881-ac68-55fb8d038e8e service nova] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:11.778246 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b21f1-3420-4430-8694-3299e50eeaf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:11.778882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b21f1-3420-4430-8694-3299e50eeaf7 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:11.779151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b21f1-3420-4430-8694-3299e50eeaf7 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:11.779447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b21f1-3420-4430-8694-3299e50eeaf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:11.787840 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b21f1-3420-4430-8694-3299e50eeaf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:11.789456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b21f1-3420-4430-8694-3299e50eeaf7 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:11.799017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1168/2309] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:14.945291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4dff4-90c0-44a3-a98f-30732449d746 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:14.953627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4dff4-90c0-44a3-a98f-30732449d746 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:14.958823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:14.960005 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:14.961625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:14.961900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] PATH_INFO: `/v3/users/61550eb9f7f44ceaa05c308df9a99613` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:14.963082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61550eb9f7f44ceaa05c308df9a99613)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:14.965037 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:15.181123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61550eb9f7f44ceaa05c308df9a99613'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:15.188680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61550eb9f7f44ceaa05c308df9a99613'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:15.189396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61550eb9f7f44ceaa05c308df9a99613'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:15.201630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61550eb9f7f44ceaa05c308df9a99613'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:15.202327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61550eb9f7f44ceaa05c308df9a99613'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:15.320568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1142/2310] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:10:14 2022] DELETE /identity/v3/users/61550eb9f7f44ceaa05c308df9a99613 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:15.325246 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ca8d4-dec6-4f58-b8cd-5a58d73a1c5b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:15.325730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ca8d4-dec6-4f58-b8cd-5a58d73a1c5b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:15.325877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ca8d4-dec6-4f58-b8cd-5a58d73a1c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:15.344017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5d8ca8d4-dec6-4f58-b8cd-5a58d73a1c5b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:15.345819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5d8ca8d4-dec6-4f58-b8cd-5a58d73a1c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:15.407986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1169/2311] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:15.420089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:15.420089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:15.483932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cfd5b-d23b-4a94-be8b-9837cc176815 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:15.488366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b062b2e-9ce5-4c77-bd76-d761ed6ff38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:15.489095 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b062b2e-9ce5-4c77-bd76-d761ed6ff38a service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:15.489376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b062b2e-9ce5-4c77-bd76-d761ed6ff38a service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:15.489644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b062b2e-9ce5-4c77-bd76-d761ed6ff38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:15.499868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b062b2e-9ce5-4c77-bd76-d761ed6ff38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:15.501447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b062b2e-9ce5-4c77-bd76-d761ed6ff38a service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:15.512627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1143/2312] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:10:15.955645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ca8d4-dec6-4f58-b8cd-5a58d73a1c5b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:15.957139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5d8ca8d4-dec6-4f58-b8cd-5a58d73a1c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:15.969812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6587-ae29-4585-9514-48d3c57df19f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:15.970303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6587-ae29-4585-9514-48d3c57df19f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:15.970570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6587-ae29-4585-9514-48d3c57df19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:15.971305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ca8d4-dec6-4f58-b8cd-5a58d73a1c5b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:15.977376 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:15.978390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:15.978752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:15.979100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] PATH_INFO: `/v3/projects/e2dc0266135948368cf75d622050939a` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:15.980536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2dc0266135948368cf75d622050939a)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:15.982697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:15.993357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1b0b6587-ae29-4585-9514-48d3c57df19f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:15.996084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1b0b6587-ae29-4585-9514-48d3c57df19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:16.002672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:16.004129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1144/2313] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:16.030389 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b6587-ae29-4585-9514-48d3c57df19f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:16.031831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1b0b6587-ae29-4585-9514-48d3c57df19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:16.093527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2dc0266135948368cf75d622050939a', 'request_id': 'req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:16.101168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2dc0266135948368cf75d622050939a', 'request_id': 'req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:16.107585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2dc0266135948368cf75d622050939a', 'request_id': 'req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:16.114894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:16.120054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b6587-ae29-4585-9514-48d3c57df19f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:16.185472 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd36a8-ecc6-4d5c-b158-da07a5022a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:16.186115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd36a8-ecc6-4d5c-b158-da07a5022a17 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.186399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd36a8-ecc6-4d5c-b158-da07a5022a17 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.186679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd36a8-ecc6-4d5c-b158-da07a5022a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.226921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] The token cache is being invalidate because project e2dc0266135948368cf75d622050939a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:10:16.227240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:16.227914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5408bea9-38b3-42cc-a94c-4c512d5e9aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:16.229471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1170/2314] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:10:15 2022] DELETE /identity/v3/projects/e2dc0266135948368cf75d622050939a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:16.234439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660d2c3-1e8c-41fa-b19c-3551c9f36dea None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.234801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660d2c3-1e8c-41fa-b19c-3551c9f36dea None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.235089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660d2c3-1e8c-41fa-b19c-3551c9f36dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.248526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd36a8-ecc6-4d5c-b158-da07a5022a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:16.250284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd36a8-ecc6-4d5c-b158-da07a5022a17 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:16.254041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d660d2c3-1e8c-41fa-b19c-3551c9f36dea None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:16.255255 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d660d2c3-1e8c-41fa-b19c-3551c9f36dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:16.261125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1145/2315] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:10:16.263936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1171/2316] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:10:16.273437 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ef55d-e37d-4126-8daf-dc7fad6307dd None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.273802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ef55d-e37d-4126-8daf-dc7fad6307dd None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.274084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ef55d-e37d-4126-8daf-dc7fad6307dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.293190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-570ef55d-e37d-4126-8daf-dc7fad6307dd None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:16.294331 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-570ef55d-e37d-4126-8daf-dc7fad6307dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:16.307607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1146/2317] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:16.311960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660d2c3-1e8c-41fa-b19c-3551c9f36dea None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:16.322698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660d2c3-1e8c-41fa-b19c-3551c9f36dea None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:16.327836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474efc3-f874-4ad0-810f-a056706ca838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:16.328634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474efc3-f874-4ad0-810f-a056706ca838 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.328922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474efc3-f874-4ad0-810f-a056706ca838 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.329281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474efc3-f874-4ad0-810f-a056706ca838 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.330708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474efc3-f874-4ad0-810f-a056706ca838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:10:16.331022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474efc3-f874-4ad0-810f-a056706ca838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:16.332724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474efc3-f874-4ad0-810f-a056706ca838 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:16.345116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1172/2318] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:10:16.349920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ef55d-e37d-4126-8daf-dc7fad6307dd None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:16.359214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ef55d-e37d-4126-8daf-dc7fad6307dd None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:16.364120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fcc1-db22-47f9-9226-9982a09b7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:16.364771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fcc1-db22-47f9-9226-9982a09b7da5 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.365058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fcc1-db22-47f9-9226-9982a09b7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.365378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fcc1-db22-47f9-9226-9982a09b7da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.366083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26fcc1-db22-47f9-9226-9982a09b7da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:16.367980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26fcc1-db22-47f9-9226-9982a09b7da5 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:16.484842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1147/2319] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:10:16 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:16.489770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474efc3-f874-4ad0-810f-a056706ca838 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:16.500985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474efc3-f874-4ad0-810f-a056706ca838 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:16.558794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23788fea-e1b7-41f3-a199-2f109e0b3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:16.559462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23788fea-e1b7-41f3-a199-2f109e0b3d39 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.559775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23788fea-e1b7-41f3-a199-2f109e0b3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.560058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23788fea-e1b7-41f3-a199-2f109e0b3d39 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.560750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23788fea-e1b7-41f3-a199-2f109e0b3d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:16.562916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23788fea-e1b7-41f3-a199-2f109e0b3d39 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:16.673258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1173/2320] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:10:16 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:16.680371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fcc1-db22-47f9-9226-9982a09b7da5 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:16.693241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fcc1-db22-47f9-9226-9982a09b7da5 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:16.698191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48449090-b91b-4482-b72b-31f32821c8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:16.699046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48449090-b91b-4482-b72b-31f32821c8ef admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.699357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48449090-b91b-4482-b72b-31f32821c8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.699661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48449090-b91b-4482-b72b-31f32821c8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.700394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48449090-b91b-4482-b72b-31f32821c8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:16.702015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48449090-b91b-4482-b72b-31f32821c8ef admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:16.712888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1148/2321] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:16.718436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23788fea-e1b7-41f3-a199-2f109e0b3d39 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:16.728591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23788fea-e1b7-41f3-a199-2f109e0b3d39 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:16.733281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e912d-9a4d-4de8-8b35-80ce6d5a2fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:16.733942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e912d-9a4d-4de8-8b35-80ce6d5a2fdb admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.734226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e912d-9a4d-4de8-8b35-80ce6d5a2fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.734500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e912d-9a4d-4de8-8b35-80ce6d5a2fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.735682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e912d-9a4d-4de8-8b35-80ce6d5a2fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:16.737748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e912d-9a4d-4de8-8b35-80ce6d5a2fdb admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:16.753349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1174/2322] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:16.754714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48449090-b91b-4482-b72b-31f32821c8ef admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:16.765704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48449090-b91b-4482-b72b-31f32821c8ef admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:16.771302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab169-ada2-42f7-b1fe-67abd26ab97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:16.772215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab169-ada2-42f7-b1fe-67abd26ab97e admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.778526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab169-ada2-42f7-b1fe-67abd26ab97e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.778526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab169-ada2-42f7-b1fe-67abd26ab97e admin admin] PATH_INFO: `/v3/projects/f6a57ee453ee4416800f48004bf14c43/users/68d7c1c12efe47ee88a7e8f54bf71d9f/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.789079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ab169-ada2-42f7-b1fe-67abd26ab97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a57ee453ee4416800f48004bf14c43, user_id=68d7c1c12efe47ee88a7e8f54bf71d9f, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:16.791783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ab169-ada2-42f7-b1fe-67abd26ab97e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:16.909255 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1149/2323] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:10:16 2022] PUT /identity/v3/projects/f6a57ee453ee4416800f48004bf14c43/users/68d7c1c12efe47ee88a7e8f54bf71d9f/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:16.920270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f544b8-72d1-44aa-9e8e-d48dd3f79b2a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:16.920560 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f544b8-72d1-44aa-9e8e-d48dd3f79b2a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:16.920894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f544b8-72d1-44aa-9e8e-d48dd3f79b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:16.949947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d6f544b8-72d1-44aa-9e8e-d48dd3f79b2a None None] MFA Rules not processed for user `68d7c1c12efe47ee88a7e8f54bf71d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:16.951151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d6f544b8-72d1-44aa-9e8e-d48dd3f79b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:17.006581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:17.018111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1175/2324] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:17.022685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab169-ada2-42f7-b1fe-67abd26ab97e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:17.059414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:17.087166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab169-ada2-42f7-b1fe-67abd26ab97e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:17.091930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3ce0d-f78d-4df0-aeb5-08add04312c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:17.094151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3ce0d-f78d-4df0-aeb5-08add04312c9 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.094151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3ce0d-f78d-4df0-aeb5-08add04312c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.094151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3ce0d-f78d-4df0-aeb5-08add04312c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.094151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3ce0d-f78d-4df0-aeb5-08add04312c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:17.096564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3ce0d-f78d-4df0-aeb5-08add04312c9 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:17.209045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1150/2325] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:10:17 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:17.213898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f544b8-72d1-44aa-9e8e-d48dd3f79b2a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:17.225884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f544b8-72d1-44aa-9e8e-d48dd3f79b2a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:17.287339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1237b-7ec5-487a-99fc-9e54c973fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:17.288280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1237b-7ec5-487a-99fc-9e54c973fad7 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.288558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1237b-7ec5-487a-99fc-9e54c973fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.288833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1237b-7ec5-487a-99fc-9e54c973fad7 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.289778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1237b-7ec5-487a-99fc-9e54c973fad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:17.291719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1237b-7ec5-487a-99fc-9e54c973fad7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:17.388433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1176/2326] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:10:17 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:17.392994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3ce0d-f78d-4df0-aeb5-08add04312c9 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:17.403679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3ce0d-f78d-4df0-aeb5-08add04312c9 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:17.409002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590c47-0e3a-404e-88b4-de36dbfacd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:17.409663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590c47-0e3a-404e-88b4-de36dbfacd84 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.409945 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590c47-0e3a-404e-88b4-de36dbfacd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.410219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590c47-0e3a-404e-88b4-de36dbfacd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.410978 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81590c47-0e3a-404e-88b4-de36dbfacd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:17.412648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81590c47-0e3a-404e-88b4-de36dbfacd84 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:17.424731 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1151/2327] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:10:17.430161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1237b-7ec5-487a-99fc-9e54c973fad7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:17.444373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1237b-7ec5-487a-99fc-9e54c973fad7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:17.449040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c709e-79b9-403a-8d41-f6718879100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:17.449919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c709e-79b9-403a-8d41-f6718879100f admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.450201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c709e-79b9-403a-8d41-f6718879100f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.450472 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c709e-79b9-403a-8d41-f6718879100f admin admin] PATH_INFO: `/v3/projects/3ebbbc200dc340e989a2019c71cb7c4c/users/fd95c58a8e5d4e90a2c2c95796b551dd/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.467496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c709e-79b9-403a-8d41-f6718879100f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebbbc200dc340e989a2019c71cb7c4c, user_id=fd95c58a8e5d4e90a2c2c95796b551dd, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:17.470216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c709e-79b9-403a-8d41-f6718879100f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:17.577860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1177/2328] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:10:17 2022] PUT /identity/v3/projects/3ebbbc200dc340e989a2019c71cb7c4c/users/fd95c58a8e5d4e90a2c2c95796b551dd/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:10:17.582533 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590c47-0e3a-404e-88b4-de36dbfacd84 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:17.592914 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590c47-0e3a-404e-88b4-de36dbfacd84 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:17.651772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59303d6-58d4-4e25-91a0-af1d680c185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:17.652495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59303d6-58d4-4e25-91a0-af1d680c185a admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.652788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59303d6-58d4-4e25-91a0-af1d680c185a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.653044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59303d6-58d4-4e25-91a0-af1d680c185a admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.653764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59303d6-58d4-4e25-91a0-af1d680c185a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:17.655401 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59303d6-58d4-4e25-91a0-af1d680c185a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:17.665503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1152/2329] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:17.669676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c709e-79b9-403a-8d41-f6718879100f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:17.680359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c709e-79b9-403a-8d41-f6718879100f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:17.685182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce26fb-ec9d-4a53-b6df-cb795770748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:17.686073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce26fb-ec9d-4a53-b6df-cb795770748a admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.686483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce26fb-ec9d-4a53-b6df-cb795770748a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.686804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce26fb-ec9d-4a53-b6df-cb795770748a admin admin] PATH_INFO: `/v3/projects/3ebbbc200dc340e989a2019c71cb7c4c/users/fd95c58a8e5d4e90a2c2c95796b551dd/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.688898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce26fb-ec9d-4a53-b6df-cb795770748a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebbbc200dc340e989a2019c71cb7c4c, user_id=fd95c58a8e5d4e90a2c2c95796b551dd, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:17.692126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce26fb-ec9d-4a53-b6df-cb795770748a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:17.702766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1178/2330] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:10:17 2022] PUT /identity/v3/projects/3ebbbc200dc340e989a2019c71cb7c4c/users/fd95c58a8e5d4e90a2c2c95796b551dd/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:10:17.713607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ece4b-78e2-4ab0-930c-1c881fb3aba3 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.715476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ece4b-78e2-4ab0-930c-1c881fb3aba3 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.715476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ece4b-78e2-4ab0-930c-1c881fb3aba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.748626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-858ece4b-78e2-4ab0-930c-1c881fb3aba3 None None] MFA Rules not processed for user `fd95c58a8e5d4e90a2c2c95796b551dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:17.749834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-858ece4b-78e2-4ab0-930c-1c881fb3aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:17.819034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1153/2331] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:17.835118 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce26fb-ec9d-4a53-b6df-cb795770748a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:17.835118 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5cce26fb-ec9d-4a53-b6df-cb795770748a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:17.890409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce26fb-ec9d-4a53-b6df-cb795770748a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:17.894767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f0b0-d256-4f0b-a527-aa987bf782c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:17.895405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f0b0-d256-4f0b-a527-aa987bf782c5 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:17.895722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f0b0-d256-4f0b-a527-aa987bf782c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:17.895998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f0b0-d256-4f0b-a527-aa987bf782c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:17.952489 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1f0b0-d256-4f0b-a527-aa987bf782c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:17.953929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1f0b0-d256-4f0b-a527-aa987bf782c5 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:17.959030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:17.963681 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1179/2332] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:18.952378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ece4b-78e2-4ab0-930c-1c881fb3aba3 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:18.954321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-858ece4b-78e2-4ab0-930c-1c881fb3aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:18.985612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:19.033959 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ece4b-78e2-4ab0-930c-1c881fb3aba3 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:19.050557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312b0b9-d468-44bf-84cf-f7bf4cce0390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:19.050557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312b0b9-d468-44bf-84cf-f7bf4cce0390 service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:19.050557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312b0b9-d468-44bf-84cf-f7bf4cce0390 service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:19.050557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312b0b9-d468-44bf-84cf-f7bf4cce0390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:19.051227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b312b0b9-d468-44bf-84cf-f7bf4cce0390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:19.071377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f0b0-d256-4f0b-a527-aa987bf782c5 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:19.073946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ead1f0b0-d256-4f0b-a527-aa987bf782c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:19.102359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312b0b9-d468-44bf-84cf-f7bf4cce0390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:19.104648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312b0b9-d468-44bf-84cf-f7bf4cce0390 service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:19.112419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f0b0-d256-4f0b-a527-aa987bf782c5 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:19.120800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217777aa-7235-4d02-a83f-28f041c69eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:19.121852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217777aa-7235-4d02-a83f-28f041c69eb6 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:19.122401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217777aa-7235-4d02-a83f-28f041c69eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:19.122742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1154/2333] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:19.123160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217777aa-7235-4d02-a83f-28f041c69eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:19.125821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-217777aa-7235-4d02-a83f-28f041c69eb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:19.140545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217777aa-7235-4d02-a83f-28f041c69eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:19.142207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217777aa-7235-4d02-a83f-28f041c69eb6 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:19.170625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1180/2334] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:19.991196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312b0b9-d468-44bf-84cf-f7bf4cce0390 service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:20.003079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312b0b9-d468-44bf-84cf-f7bf4cce0390 service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:20.008873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d7e59-6860-436e-ae74-dea4b0cbf4db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:20.012816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d7e59-6860-436e-ae74-dea4b0cbf4db service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:20.012816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d7e59-6860-436e-ae74-dea4b0cbf4db service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:20.012816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d7e59-6860-436e-ae74-dea4b0cbf4db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:20.012816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-720d7e59-6860-436e-ae74-dea4b0cbf4db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:20.092438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d7e59-6860-436e-ae74-dea4b0cbf4db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:20.094087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d7e59-6860-436e-ae74-dea4b0cbf4db service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:20.106120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1155/2335] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:20.290973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ff60b-72b5-43b6-a988-72fae5939fd2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:20.291395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ff60b-72b5-43b6-a988-72fae5939fd2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:20.291601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ff60b-72b5-43b6-a988-72fae5939fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:20.331656 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4d5ff60b-72b5-43b6-a988-72fae5939fd2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:20.332871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4d5ff60b-72b5-43b6-a988-72fae5939fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:20.402618 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1181/2336] 10.222.0.72 () {58 vars in 1016 bytes} [Thu May 26 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:20.436913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d7e59-6860-436e-ae74-dea4b0cbf4db service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:20.449044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d7e59-6860-436e-ae74-dea4b0cbf4db service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:20.456070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76079-7963-4c48-9393-0e6ee4c869ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:20.456780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76079-7963-4c48-9393-0e6ee4c869ba service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:20.457076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76079-7963-4c48-9393-0e6ee4c869ba service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:20.457382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76079-7963-4c48-9393-0e6ee4c869ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:20.471872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76079-7963-4c48-9393-0e6ee4c869ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:20.471872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76079-7963-4c48-9393-0e6ee4c869ba service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:20.481580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1156/2337] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:21.379944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ff60b-72b5-43b6-a988-72fae5939fd2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:21.381404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4d5ff60b-72b5-43b6-a988-72fae5939fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:21.393884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ff60b-72b5-43b6-a988-72fae5939fd2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:21.397775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75db1e-d572-4e87-9acb-c9f4fd802130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:21.398503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75db1e-d572-4e87-9acb-c9f4fd802130 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:21.398856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75db1e-d572-4e87-9acb-c9f4fd802130 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:21.399138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75db1e-d572-4e87-9acb-c9f4fd802130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:21.410535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75db1e-d572-4e87-9acb-c9f4fd802130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:21.412064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75db1e-d572-4e87-9acb-c9f4fd802130 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:21.422858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1182/2338] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:30.475460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=55 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:31.418001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=39 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:37.147119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76079-7963-4c48-9393-0e6ee4c869ba service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:37.157426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76079-7963-4c48-9393-0e6ee4c869ba service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:37.166724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:37.166724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:37.166724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:37.166724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] PATH_INFO: `/v3/users/68d7c1c12efe47ee88a7e8f54bf71d9f` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:37.167204 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d7c1c12efe47ee88a7e8f54bf71d9f)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:37.167204 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:37.369614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d7c1c12efe47ee88a7e8f54bf71d9f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:37.379178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d7c1c12efe47ee88a7e8f54bf71d9f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:37.380651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d7c1c12efe47ee88a7e8f54bf71d9f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:37.394417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d7c1c12efe47ee88a7e8f54bf71d9f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:37.395097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d7c1c12efe47ee88a7e8f54bf71d9f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:37.489318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1157/2339] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:10:37 2022] DELETE /identity/v3/users/68d7c1c12efe47ee88a7e8f54bf71d9f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:37.493824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a73a-bd52-4900-80f2-b3f1b3924773 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:37.494310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a73a-bd52-4900-80f2-b3f1b3924773 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:37.494421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a73a-bd52-4900-80f2-b3f1b3924773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:37.518158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e6d5a73a-bd52-4900-80f2-b3f1b3924773 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:37.519346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e6d5a73a-bd52-4900-80f2-b3f1b3924773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:37.577461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1183/2340] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:10:37.587288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:37.588769 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:37.647737 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6b2e2-93ef-47dc-930e-7f6557146369 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:37.651501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6e659-448f-4d53-ab76-54f5e1a5b048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:37.652178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6e659-448f-4d53-ab76-54f5e1a5b048 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:37.652465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6e659-448f-4d53-ab76-54f5e1a5b048 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:37.652745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6e659-448f-4d53-ab76-54f5e1a5b048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:37.662462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6e659-448f-4d53-ab76-54f5e1a5b048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:37.663964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6e659-448f-4d53-ab76-54f5e1a5b048 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:37.674277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1158/2341] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:38.100875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a73a-bd52-4900-80f2-b3f1b3924773 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:38.103473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e6d5a73a-bd52-4900-80f2-b3f1b3924773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:38.129534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a73a-bd52-4900-80f2-b3f1b3924773 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:38.136252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:38.137269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:38.137406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:38.137670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] PATH_INFO: `/v3/projects/f6a57ee453ee4416800f48004bf14c43` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:38.139014 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a57ee453ee4416800f48004bf14c43)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:38.142349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:38.216887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949e79d-4419-44d7-87c1-12f346cde192 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:38.217605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949e79d-4419-44d7-87c1-12f346cde192 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:38.217713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949e79d-4419-44d7-87c1-12f346cde192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:38.235861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-2949e79d-4419-44d7-87c1-12f346cde192 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:38.237060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2949e79d-4419-44d7-87c1-12f346cde192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:38.300855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1159/2342] 10.222.0.93 () {58 vars in 967 bytes} [Thu May 26 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:10:38.310771 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a57ee453ee4416800f48004bf14c43', 'request_id': 'req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.319704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a57ee453ee4416800f48004bf14c43', 'request_id': 'req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.329267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a57ee453ee4416800f48004bf14c43', 'request_id': 'req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.473334 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] The token cache is being invalidate because project f6a57ee453ee4416800f48004bf14c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:10:38.473626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.474477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.476107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1184/2343] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:10:38 2022] DELETE /identity/v3/projects/f6a57ee453ee4416800f48004bf14c43 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:38.480405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949e79d-4419-44d7-87c1-12f346cde192 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:38.491704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949e79d-4419-44d7-87c1-12f346cde192 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:38.507139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:38.508283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:38.513497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:38.565135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:38.565931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:38.566215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:38.566594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] PATH_INFO: `/v3/users/fd95c58a8e5d4e90a2c2c95796b551dd` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:38.568268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd95c58a8e5d4e90a2c2c95796b551dd)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:38.570431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:38.590448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac68f-27a7-4e53-aeb6-3270be5e1b7c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:38.596168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:38.596834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:38.597119 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:38.597399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:38.599492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:38.628866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:38.676903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:38.684568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:38.700705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1185/2344] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:10:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 17:10:38.809242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd95c58a8e5d4e90a2c2c95796b551dd'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.817937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd95c58a8e5d4e90a2c2c95796b551dd'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.818459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd95c58a8e5d4e90a2c2c95796b551dd'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.831323 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd95c58a8e5d4e90a2c2c95796b551dd'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.833189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e1e165e-1eee-4d1d-b211-0610a23531d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd95c58a8e5d4e90a2c2c95796b551dd'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:38.954124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1160/2345] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:10:38 2022] DELETE /identity/v3/users/fd95c58a8e5d4e90a2c2c95796b551dd => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:39.389915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:39.391385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:39.406007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cd700-23f7-470a-bfd9-dc59b16b9139 service swift] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:39.469349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:39.470413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:39.470691 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:39.471007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] PATH_INFO: `/v3/projects/3ebbbc200dc340e989a2019c71cb7c4c` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:39.476081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebbbc200dc340e989a2019c71cb7c4c)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:39.478130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:39.646081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebbbc200dc340e989a2019c71cb7c4c', 'request_id': 'req-0c2a942d-1aef-4379-8495-78221c0c4992'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:39.652337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebbbc200dc340e989a2019c71cb7c4c', 'request_id': 'req-0c2a942d-1aef-4379-8495-78221c0c4992'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:39.658712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebbbc200dc340e989a2019c71cb7c4c', 'request_id': 'req-0c2a942d-1aef-4379-8495-78221c0c4992'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:39.761146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] The token cache is being invalidate because project 3ebbbc200dc340e989a2019c71cb7c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:10:39.761146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:39.762227 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c2a942d-1aef-4379-8495-78221c0c4992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:39.767056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1186/2346] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:10:39 2022] DELETE /identity/v3/projects/3ebbbc200dc340e989a2019c71cb7c4c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:39.769368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3d28c-8ae5-42af-a4fe-75f78b1cabbb None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:39.769880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3d28c-8ae5-42af-a4fe-75f78b1cabbb None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:39.770133 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3d28c-8ae5-42af-a4fe-75f78b1cabbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:39.790496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0ee3d28c-8ae5-42af-a4fe-75f78b1cabbb None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:39.791720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0ee3d28c-8ae5-42af-a4fe-75f78b1cabbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:39.919690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1161/2347] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:39.925629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62bbf5-c19b-4cd3-a213-38ea305cf1fe None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:39.931203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62bbf5-c19b-4cd3-a213-38ea305cf1fe None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:39.931203 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62bbf5-c19b-4cd3-a213-38ea305cf1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:39.947908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4d62bbf5-c19b-4cd3-a213-38ea305cf1fe None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:39.949120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4d62bbf5-c19b-4cd3-a213-38ea305cf1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:39.961761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1187/2348] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:39.966264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3d28c-8ae5-42af-a4fe-75f78b1cabbb None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:39.978550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3d28c-8ae5-42af-a4fe-75f78b1cabbb None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:39.983750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6175dc-564c-4303-b1ef-2111ba01a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:39.984425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6175dc-564c-4303-b1ef-2111ba01a287 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:39.984712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6175dc-564c-4303-b1ef-2111ba01a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:39.985022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6175dc-564c-4303-b1ef-2111ba01a287 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:39.985732 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6175dc-564c-4303-b1ef-2111ba01a287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:10:39.986047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6175dc-564c-4303-b1ef-2111ba01a287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:39.987792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6175dc-564c-4303-b1ef-2111ba01a287 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:40.005870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1162/2349] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:10:40.010254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62bbf5-c19b-4cd3-a213-38ea305cf1fe None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:40.019822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62bbf5-c19b-4cd3-a213-38ea305cf1fe None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:40.025367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bddfe3-d51b-4440-8cbe-8a389df93569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:40.026010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bddfe3-d51b-4440-8cbe-8a389df93569 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:40.026288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bddfe3-d51b-4440-8cbe-8a389df93569 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:40.026558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bddfe3-d51b-4440-8cbe-8a389df93569 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:40.027266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bddfe3-d51b-4440-8cbe-8a389df93569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:40.029201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bddfe3-d51b-4440-8cbe-8a389df93569 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:40.177970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1188/2350] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:10:40 2022] POST /identity/v3/projects => generated 401 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:40.181804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6175dc-564c-4303-b1ef-2111ba01a287 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:40.192358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6175dc-564c-4303-b1ef-2111ba01a287 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:40.220078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:40.256148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892e44c-80bb-4349-ab07-7d1a943318d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:40.256941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892e44c-80bb-4349-ab07-7d1a943318d2 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:40.257273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892e44c-80bb-4349-ab07-7d1a943318d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:40.257587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892e44c-80bb-4349-ab07-7d1a943318d2 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:40.258327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892e44c-80bb-4349-ab07-7d1a943318d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:40.260373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892e44c-80bb-4349-ab07-7d1a943318d2 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:40.389484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1163/2351] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:10:40 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:40.393867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bddfe3-d51b-4440-8cbe-8a389df93569 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:40.405135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bddfe3-d51b-4440-8cbe-8a389df93569 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:40.413950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a6a9d-7e51-4f77-b46f-294f7826079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:40.417544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a6a9d-7e51-4f77-b46f-294f7826079b admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:40.417544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a6a9d-7e51-4f77-b46f-294f7826079b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:40.417544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a6a9d-7e51-4f77-b46f-294f7826079b admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:40.417544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a6a9d-7e51-4f77-b46f-294f7826079b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:40.417999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a6a9d-7e51-4f77-b46f-294f7826079b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:40.428590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1189/2352] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:40.432524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892e44c-80bb-4349-ab07-7d1a943318d2 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:40.442515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892e44c-80bb-4349-ab07-7d1a943318d2 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:40.447162 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da681a-ba13-4311-97dc-cb93a615b017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:40.447850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da681a-ba13-4311-97dc-cb93a615b017 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:40.448146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da681a-ba13-4311-97dc-cb93a615b017 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:40.448413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da681a-ba13-4311-97dc-cb93a615b017 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:40.449135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da681a-ba13-4311-97dc-cb93a615b017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:40.450754 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da681a-ba13-4311-97dc-cb93a615b017 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:40.461818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1164/2353] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:40.465901 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a6a9d-7e51-4f77-b46f-294f7826079b admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:40.477191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a6a9d-7e51-4f77-b46f-294f7826079b admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:40.481931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c14e79-c760-4afa-8fd6-7b5513de14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:40.487302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14e79-c760-4afa-8fd6-7b5513de14c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:40.487302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14e79-c760-4afa-8fd6-7b5513de14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:40.487302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14e79-c760-4afa-8fd6-7b5513de14c0 admin admin] PATH_INFO: `/v3/projects/39335c4f010d4d5cbd887d165782ad3e/users/e2cd27fc267044d7a0b6339c822b3e02/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:40.487302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:40.499195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c14e79-c760-4afa-8fd6-7b5513de14c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39335c4f010d4d5cbd887d165782ad3e, user_id=e2cd27fc267044d7a0b6339c822b3e02, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:40.501978 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c14e79-c760-4afa-8fd6-7b5513de14c0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:40.599245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1190/2354] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:10:40 2022] PUT /identity/v3/projects/39335c4f010d4d5cbd887d165782ad3e/users/e2cd27fc267044d7a0b6339c822b3e02/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:10:40.609618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c62a9-eaec-48bc-bcb4-87cbefa93d0b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:40.609907 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c62a9-eaec-48bc-bcb4-87cbefa93d0b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:40.610188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c62a9-eaec-48bc-bcb4-87cbefa93d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:40.637151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-108c62a9-eaec-48bc-bcb4-87cbefa93d0b None None] MFA Rules not processed for user `e2cd27fc267044d7a0b6339c822b3e02`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:40.638425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-108c62a9-eaec-48bc-bcb4-87cbefa93d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:40.711830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1165/2355] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:40.716245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c14e79-c760-4afa-8fd6-7b5513de14c0 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:40.783650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c14e79-c760-4afa-8fd6-7b5513de14c0 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:40.788654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44d444-1520-42e7-bc39-fd0793a205d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:40.789310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d444-1520-42e7-bc39-fd0793a205d4 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:40.789591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d444-1520-42e7-bc39-fd0793a205d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:40.789862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d444-1520-42e7-bc39-fd0793a205d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:40.790576 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44d444-1520-42e7-bc39-fd0793a205d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:40.792567 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44d444-1520-42e7-bc39-fd0793a205d4 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:40.893302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1191/2356] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:10:40 2022] POST /identity/v3/projects => generated 401 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:40.898016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c62a9-eaec-48bc-bcb4-87cbefa93d0b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:40.909743 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c62a9-eaec-48bc-bcb4-87cbefa93d0b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:40.973926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59abe0-c5f3-4112-946d-dcbcf8ce24dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:40.974744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59abe0-c5f3-4112-946d-dcbcf8ce24dc admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:40.974947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59abe0-c5f3-4112-946d-dcbcf8ce24dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:40.975223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59abe0-c5f3-4112-946d-dcbcf8ce24dc admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:40.975958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59abe0-c5f3-4112-946d-dcbcf8ce24dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:40.978017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59abe0-c5f3-4112-946d-dcbcf8ce24dc admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:41.084092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1166/2357] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:10:40 2022] POST /identity/v3/users => generated 307 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:41.085485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44d444-1520-42e7-bc39-fd0793a205d4 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:41.098424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44d444-1520-42e7-bc39-fd0793a205d4 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:41.115978 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717bba-97ef-4f8d-ba4d-8c714b6520ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:41.117367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717bba-97ef-4f8d-ba4d-8c714b6520ff admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:41.117960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717bba-97ef-4f8d-ba4d-8c714b6520ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:41.119171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717bba-97ef-4f8d-ba4d-8c714b6520ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:41.122422 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717bba-97ef-4f8d-ba4d-8c714b6520ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:41.124225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717bba-97ef-4f8d-ba4d-8c714b6520ff admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:41.155223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1192/2358] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:41.159726 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59abe0-c5f3-4112-946d-dcbcf8ce24dc admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:41.175423 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59abe0-c5f3-4112-946d-dcbcf8ce24dc admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:41.186785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed1d2c-1a3a-44d7-a978-ec78396d2e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:41.193458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed1d2c-1a3a-44d7-a978-ec78396d2e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:41.193458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed1d2c-1a3a-44d7-a978-ec78396d2e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:41.193458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed1d2c-1a3a-44d7-a978-ec78396d2e42 admin admin] PATH_INFO: `/v3/projects/e3b966c3d97c4038814d02d8af28143f/users/d3a29b651d654d4381829e89bc4ead55/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:41.248105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed1d2c-1a3a-44d7-a978-ec78396d2e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b966c3d97c4038814d02d8af28143f, user_id=d3a29b651d654d4381829e89bc4ead55, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:41.259275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed1d2c-1a3a-44d7-a978-ec78396d2e42 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:41.379941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:41.386314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1167/2359] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:10:41 2022] PUT /identity/v3/projects/e3b966c3d97c4038814d02d8af28143f/users/d3a29b651d654d4381829e89bc4ead55/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:41.393220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717bba-97ef-4f8d-ba4d-8c714b6520ff admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:41.407500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717bba-97ef-4f8d-ba4d-8c714b6520ff admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:41.476150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed0a14-70fc-4268-8330-118a7bb8b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:41.476859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0a14-70fc-4268-8330-118a7bb8b8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:41.477145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0a14-70fc-4268-8330-118a7bb8b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:41.477562 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0a14-70fc-4268-8330-118a7bb8b8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:41.478541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed0a14-70fc-4268-8330-118a7bb8b8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:41.481574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed0a14-70fc-4268-8330-118a7bb8b8a5 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:41.496036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1193/2360] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:41.497254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed1d2c-1a3a-44d7-a978-ec78396d2e42 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:41.509875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed1d2c-1a3a-44d7-a978-ec78396d2e42 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:41.516489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3774f3-5718-4b01-b7df-74118ceb258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:41.517739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3774f3-5718-4b01-b7df-74118ceb258e admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:41.518418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3774f3-5718-4b01-b7df-74118ceb258e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:41.519287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3774f3-5718-4b01-b7df-74118ceb258e admin admin] PATH_INFO: `/v3/projects/e3b966c3d97c4038814d02d8af28143f/users/d3a29b651d654d4381829e89bc4ead55/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:41.521939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3774f3-5718-4b01-b7df-74118ceb258e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b966c3d97c4038814d02d8af28143f, user_id=d3a29b651d654d4381829e89bc4ead55, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:41.525108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3774f3-5718-4b01-b7df-74118ceb258e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:41.539721 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1168/2361] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:10:41 2022] PUT /identity/v3/projects/e3b966c3d97c4038814d02d8af28143f/users/d3a29b651d654d4381829e89bc4ead55/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:41.551071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4a95-7001-4ed8-80b7-6706e4cfae07 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:41.551905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4a95-7001-4ed8-80b7-6706e4cfae07 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:41.552216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4a95-7001-4ed8-80b7-6706e4cfae07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:41.580807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-44cd4a95-7001-4ed8-80b7-6706e4cfae07 None None] MFA Rules not processed for user `d3a29b651d654d4381829e89bc4ead55`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:41.582018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-44cd4a95-7001-4ed8-80b7-6706e4cfae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:41.626539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:41.666372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1194/2362] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:10:41.678826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3774f3-5718-4b01-b7df-74118ceb258e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:41.682183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bb3774f3-5718-4b01-b7df-74118ceb258e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:41.755766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3774f3-5718-4b01-b7df-74118ceb258e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:41.760499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03858928-fa1d-420a-bbc3-64aa2c5bebe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:41.761257 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03858928-fa1d-420a-bbc3-64aa2c5bebe5 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:41.761733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03858928-fa1d-420a-bbc3-64aa2c5bebe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:41.762018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03858928-fa1d-420a-bbc3-64aa2c5bebe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:41.780433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03858928-fa1d-420a-bbc3-64aa2c5bebe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:41.783227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03858928-fa1d-420a-bbc3-64aa2c5bebe5 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:41.803814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1169/2363] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:42.183100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4a95-7001-4ed8-80b7-6706e4cfae07 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:42.194892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4a95-7001-4ed8-80b7-6706e4cfae07 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:42.210131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e1d88-9008-4d9c-b2b9-e134f8377685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:42.211134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e1d88-9008-4d9c-b2b9-e134f8377685 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:42.211706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e1d88-9008-4d9c-b2b9-e134f8377685 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:42.212187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e1d88-9008-4d9c-b2b9-e134f8377685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:42.315188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e1d88-9008-4d9c-b2b9-e134f8377685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:42.317815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e1d88-9008-4d9c-b2b9-e134f8377685 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:42.340619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1195/2364] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:44.019988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e29f-f9d2-46fd-949c-9836af085da6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:44.020492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e29f-f9d2-46fd-949c-9836af085da6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:44.020492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e29f-f9d2-46fd-949c-9836af085da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:44.043087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1fb7e29f-f9d2-46fd-949c-9836af085da6 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:44.044476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1fb7e29f-f9d2-46fd-949c-9836af085da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:44.131241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1170/2365] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:10:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:44.143345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e1d88-9008-4d9c-b2b9-e134f8377685 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:44.145423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b51e1d88-9008-4d9c-b2b9-e134f8377685 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:44.233649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e1d88-9008-4d9c-b2b9-e134f8377685 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:44.244123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf2580-3f67-4617-986d-096de5dc5677 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:44.245191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2580-3f67-4617-986d-096de5dc5677 service swift] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:44.245635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2580-3f67-4617-986d-096de5dc5677 service swift] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:44.246085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2580-3f67-4617-986d-096de5dc5677 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:44.257849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf2580-3f67-4617-986d-096de5dc5677 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:44.259970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf2580-3f67-4617-986d-096de5dc5677 service swift] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:44.273471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1196/2366] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:10:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:10:49.182249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e29f-f9d2-46fd-949c-9836af085da6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:49.302953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e29f-f9d2-46fd-949c-9836af085da6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:49.313179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:49.317018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:49.317370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:49.317619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] PATH_INFO: `/v3/users/e2cd27fc267044d7a0b6339c822b3e02` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:49.324376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cd27fc267044d7a0b6339c822b3e02)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:49.329072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:49.652742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:49.670826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cd27fc267044d7a0b6339c822b3e02'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:49.708305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cd27fc267044d7a0b6339c822b3e02'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:49.709285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cd27fc267044d7a0b6339c822b3e02'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:49.725520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cd27fc267044d7a0b6339c822b3e02'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:49.726235 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-839a3b4c-3455-4113-9458-44c3635f8e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cd27fc267044d7a0b6339c822b3e02'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:49.802081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf2580-3f67-4617-986d-096de5dc5677 service swift] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:49.803608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7abf2580-3f67-4617-986d-096de5dc5677 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:49.821302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf2580-3f67-4617-986d-096de5dc5677 service swift] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:49.821960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1171/2367] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:10:49 2022] DELETE /identity/v3/users/e2cd27fc267044d7a0b6339c822b3e02 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:49.827623 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6e53-a2ac-42e1-9c6c-9b90b1952588 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:49.827926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6e53-a2ac-42e1-9c6c-9b90b1952588 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:49.828209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6e53-a2ac-42e1-9c6c-9b90b1952588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:49.859003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-869e6e53-a2ac-42e1-9c6c-9b90b1952588 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:49.860538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-869e6e53-a2ac-42e1-9c6c-9b90b1952588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:49.922038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:49.923617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:49.926670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:49.927277 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] PATH_INFO: `/v3/users/235a1d57f6ba448fbf23dbf25ff2983c` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:49.928898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235a1d57f6ba448fbf23dbf25ff2983c)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:49.931695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:49.939194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:49.941863 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1172/2368] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:49.947701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e6e53-a2ac-42e1-9c6c-9b90b1952588 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:49.952270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-869e6e53-a2ac-42e1-9c6c-9b90b1952588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:50.040673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e6e53-a2ac-42e1-9c6c-9b90b1952588 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:50.062273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0616ec-3b58-4027-83ba-b973f2852245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:50.062692 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0616ec-3b58-4027-83ba-b973f2852245 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:50.062838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0616ec-3b58-4027-83ba-b973f2852245 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:50.065949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0616ec-3b58-4027-83ba-b973f2852245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:50.081501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0616ec-3b58-4027-83ba-b973f2852245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:50.083865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0616ec-3b58-4027-83ba-b973f2852245 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:50.095146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1173/2369] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:10:50.139285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235a1d57f6ba448fbf23dbf25ff2983c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.256335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235a1d57f6ba448fbf23dbf25ff2983c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.272344 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235a1d57f6ba448fbf23dbf25ff2983c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.300171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235a1d57f6ba448fbf23dbf25ff2983c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.305209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235a1d57f6ba448fbf23dbf25ff2983c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.318327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1197/2370] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:10:49 2022] DELETE /identity/v3/users/235a1d57f6ba448fbf23dbf25ff2983c => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:50.654335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0616ec-3b58-4027-83ba-b973f2852245 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:50.655892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3e0616ec-3b58-4027-83ba-b973f2852245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:50.679575 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0616ec-3b58-4027-83ba-b973f2852245 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:50.714733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:50.718633 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:50.756161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:50.765679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:50.767124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:50.767455 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:50.767786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] PATH_INFO: `/v3/projects/39335c4f010d4d5cbd887d165782ad3e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:50.770198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=39335c4f010d4d5cbd887d165782ad3e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:50.775333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:50.849116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97ea1-39c9-40a9-b979-57664ab81158 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:50.854008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:50.855210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:50.855974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:50.856427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] PATH_INFO: `/v3/projects/e8cdff34f2b54b708295b3fa14e33cf1` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:50.857861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cdff34f2b54b708295b3fa14e33cf1)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:50.859803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:50.905529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39335c4f010d4d5cbd887d165782ad3e', 'request_id': 'req-8abee9f7-8036-4622-abc8-b74fee8f0fea'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.916231 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39335c4f010d4d5cbd887d165782ad3e', 'request_id': 'req-8abee9f7-8036-4622-abc8-b74fee8f0fea'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.923823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39335c4f010d4d5cbd887d165782ad3e', 'request_id': 'req-8abee9f7-8036-4622-abc8-b74fee8f0fea'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.971862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cdff34f2b54b708295b3fa14e33cf1', 'request_id': 'req-101869d4-c309-43cb-b496-0f80b843fb55'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.985093 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cdff34f2b54b708295b3fa14e33cf1', 'request_id': 'req-101869d4-c309-43cb-b496-0f80b843fb55'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:50.992283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cdff34f2b54b708295b3fa14e33cf1', 'request_id': 'req-101869d4-c309-43cb-b496-0f80b843fb55'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.043029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] The token cache is being invalidate because project 39335c4f010d4d5cbd887d165782ad3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:10:51.043317 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.043979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.046723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1174/2371] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:10:50 2022] DELETE /identity/v3/projects/39335c4f010d4d5cbd887d165782ad3e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:51.050317 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:51.052240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:51.145588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] The token cache is being invalidate because project e8cdff34f2b54b708295b3fa14e33cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:10:51.146111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.147154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.150131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1198/2372] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:10:50 2022] DELETE /identity/v3/projects/e8cdff34f2b54b708295b3fa14e33cf1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:10:51.156379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:51.159392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:51.252234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abee9f7-8036-4622-abc8-b74fee8f0fea admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:51.280195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:51.348193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:51.348193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:51.348193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:51.348497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] PATH_INFO: `/v3/users/d3a29b651d654d4381829e89bc4ead55` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:51.352753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a29b651d654d4381829e89bc4ead55)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:51.356274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:51.453533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101869d4-c309-43cb-b496-0f80b843fb55 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:51.467673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:51.487690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:51.487690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:51.487690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] PATH_INFO: `/v3/users/f4f142b404b04ccdb561ea14b3373a04` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:51.490532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f142b404b04ccdb561ea14b3373a04)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:51.492832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:51.716268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:51.729857 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a29b651d654d4381829e89bc4ead55'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.749619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a29b651d654d4381829e89bc4ead55'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.749619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a29b651d654d4381829e89bc4ead55'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.763104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a29b651d654d4381829e89bc4ead55'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.766370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a29b651d654d4381829e89bc4ead55'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.789343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f142b404b04ccdb561ea14b3373a04'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.868503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1175/2373] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:10:51 2022] DELETE /identity/v3/users/d3a29b651d654d4381829e89bc4ead55 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:10:51.912207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f142b404b04ccdb561ea14b3373a04'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.928645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f142b404b04ccdb561ea14b3373a04'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.953384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f142b404b04ccdb561ea14b3373a04'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.954600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f142b404b04ccdb561ea14b3373a04'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:51.974671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1199/2374] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:10:51 2022] DELETE /identity/v3/users/f4f142b404b04ccdb561ea14b3373a04 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:10:52.348946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:52.350648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:52.441375 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:52.442918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:52.473098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218eea8-069c-4713-92d0-daf266660714 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:52.581670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063329-96d0-41c3-81ed-8569bd601aa4 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:52.589191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:52.590347 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:52.590635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:52.590915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] PATH_INFO: `/v3/projects/e3b966c3d97c4038814d02d8af28143f` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:52.592134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b966c3d97c4038814d02d8af28143f)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:52.595233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:52.598183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:52.599280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:52.600388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:52.600881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] PATH_INFO: `/v3/projects/af58720a67b44e7db1092d4ad61520c3` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:52.604292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=af58720a67b44e7db1092d4ad61520c3)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:52.606642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:53.053307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:53.061602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af58720a67b44e7db1092d4ad61520c3', 'request_id': 'req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.064804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b966c3d97c4038814d02d8af28143f', 'request_id': 'req-488a6ecb-ca10-402b-af48-aa51a5868dfb'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.068185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af58720a67b44e7db1092d4ad61520c3', 'request_id': 'req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.072012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b966c3d97c4038814d02d8af28143f', 'request_id': 'req-488a6ecb-ca10-402b-af48-aa51a5868dfb'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.074577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af58720a67b44e7db1092d4ad61520c3', 'request_id': 'req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.076286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:53.078056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b966c3d97c4038814d02d8af28143f', 'request_id': 'req-488a6ecb-ca10-402b-af48-aa51a5868dfb'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.208531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] The token cache is being invalidate because project af58720a67b44e7db1092d4ad61520c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:10:53.208531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.208531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-aeb4dbd6-8618-42e7-98f3-3e5e9e08ce0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.210112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1176/2375] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:10:52 2022] DELETE /identity/v3/projects/af58720a67b44e7db1092d4ad61520c3 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:53.274927 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] The token cache is being invalidate because project e3b966c3d97c4038814d02d8af28143f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:10:53.275664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.276707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-488a6ecb-ca10-402b-af48-aa51a5868dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:53.279238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1200/2376] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:10:52 2022] DELETE /identity/v3/projects/e3b966c3d97c4038814d02d8af28143f => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:10:53.286144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a648307-2c2d-4b4d-9ddd-9aeaf8f4ee19 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:53.286544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a648307-2c2d-4b4d-9ddd-9aeaf8f4ee19 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:53.286947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a648307-2c2d-4b4d-9ddd-9aeaf8f4ee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:53.316562 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-7a648307-2c2d-4b4d-9ddd-9aeaf8f4ee19 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:53.318234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7a648307-2c2d-4b4d-9ddd-9aeaf8f4ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:53.459685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1177/2377] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:53.468573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ceca-247e-4512-88bc-8e306c116975 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:53.469024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ceca-247e-4512-88bc-8e306c116975 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:53.469432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ceca-247e-4512-88bc-8e306c116975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:53.533195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4c45ceca-247e-4512-88bc-8e306c116975 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:53.534440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4c45ceca-247e-4512-88bc-8e306c116975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:53.564391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1201/2378] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:53.567228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a648307-2c2d-4b4d-9ddd-9aeaf8f4ee19 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:53.583840 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a648307-2c2d-4b4d-9ddd-9aeaf8f4ee19 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:53.592720 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5806-3a67-4e6d-8189-99850fb03b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:53.593957 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5806-3a67-4e6d-8189-99850fb03b68 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:53.595110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5806-3a67-4e6d-8189-99850fb03b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:53.595695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5806-3a67-4e6d-8189-99850fb03b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:53.615899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5806-3a67-4e6d-8189-99850fb03b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:10:53.615899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5806-3a67-4e6d-8189-99850fb03b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:53.615899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5806-3a67-4e6d-8189-99850fb03b68 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:53.627160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1178/2379] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:10:53.629638 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ceca-247e-4512-88bc-8e306c116975 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:53.641527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ceca-247e-4512-88bc-8e306c116975 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:53.646812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cd2fd-5c9e-422e-847b-4a1fb7eb9e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:53.647619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cd2fd-5c9e-422e-847b-4a1fb7eb9e9c admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:53.647906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cd2fd-5c9e-422e-847b-4a1fb7eb9e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:53.648367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cd2fd-5c9e-422e-847b-4a1fb7eb9e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:53.649242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cd2fd-5c9e-422e-847b-4a1fb7eb9e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:53.651149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cd2fd-5c9e-422e-847b-4a1fb7eb9e9c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:53.744112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1202/2380] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:10:53 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:53.747913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5806-3a67-4e6d-8189-99850fb03b68 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:53.765844 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5806-3a67-4e6d-8189-99850fb03b68 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:53.859274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac3cdd-e71d-4bf4-a470-36675bc8fe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:53.860687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac3cdd-e71d-4bf4-a470-36675bc8fe28 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:53.861143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac3cdd-e71d-4bf4-a470-36675bc8fe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:53.861710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac3cdd-e71d-4bf4-a470-36675bc8fe28 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:53.862656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac3cdd-e71d-4bf4-a470-36675bc8fe28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:53.865586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac3cdd-e71d-4bf4-a470-36675bc8fe28 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:53.975926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1179/2381] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:10:53 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:10:53.981042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cd2fd-5c9e-422e-847b-4a1fb7eb9e9c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:53.996773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cd2fd-5c9e-422e-847b-4a1fb7eb9e9c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:54.001779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bcd2f-ca87-43e7-9315-e52604a1f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:54.002472 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bcd2f-ca87-43e7-9315-e52604a1f9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:54.002757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bcd2f-ca87-43e7-9315-e52604a1f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:54.003075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bcd2f-ca87-43e7-9315-e52604a1f9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:54.004427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bcd2f-ca87-43e7-9315-e52604a1f9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:54.006078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bcd2f-ca87-43e7-9315-e52604a1f9c0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:54.018636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1203/2382] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:54.023149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac3cdd-e71d-4bf4-a470-36675bc8fe28 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:54.035876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac3cdd-e71d-4bf4-a470-36675bc8fe28 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:54.040902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ce33f-e3ed-40c4-9928-e00639b35516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:54.041613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce33f-e3ed-40c4-9928-e00639b35516 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:54.041895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce33f-e3ed-40c4-9928-e00639b35516 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:54.042169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce33f-e3ed-40c4-9928-e00639b35516 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:54.042899 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ce33f-e3ed-40c4-9928-e00639b35516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:54.045409 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ce33f-e3ed-40c4-9928-e00639b35516 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:54.063107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bcd2f-ca87-43e7-9315-e52604a1f9c0 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:54.064812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1180/2383] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:54.077513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bcd2f-ca87-43e7-9315-e52604a1f9c0 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:54.082936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc004244-10db-4507-b974-6d615fde85c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:54.083861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc004244-10db-4507-b974-6d615fde85c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:54.084172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc004244-10db-4507-b974-6d615fde85c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:54.084511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc004244-10db-4507-b974-6d615fde85c7 admin admin] PATH_INFO: `/v3/projects/c4599a7498da4eaaba5d8b1c3bcf8e54/users/f963d9356ccb4e548084605fbe82e6aa/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:54.108281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc004244-10db-4507-b974-6d615fde85c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4599a7498da4eaaba5d8b1c3bcf8e54, user_id=f963d9356ccb4e548084605fbe82e6aa, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:54.111078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc004244-10db-4507-b974-6d615fde85c7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:54.235186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1204/2384] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:10:54 2022] PUT /identity/v3/projects/c4599a7498da4eaaba5d8b1c3bcf8e54/users/f963d9356ccb4e548084605fbe82e6aa/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:54.250647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894d037-4d90-4130-884b-c7da3e788607 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:54.251038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894d037-4d90-4130-884b-c7da3e788607 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:54.251330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894d037-4d90-4130-884b-c7da3e788607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:54.285505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c894d037-4d90-4130-884b-c7da3e788607 None None] MFA Rules not processed for user `f963d9356ccb4e548084605fbe82e6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:54.286986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c894d037-4d90-4130-884b-c7da3e788607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:54.339108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:54.362073 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1181/2385] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:54.374116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc004244-10db-4507-b974-6d615fde85c7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:54.376535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bc004244-10db-4507-b974-6d615fde85c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:54.444746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc004244-10db-4507-b974-6d615fde85c7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:54.448875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac7e7a-4b1e-4661-ae40-ae1fb38d1689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:54.449697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac7e7a-4b1e-4661-ae40-ae1fb38d1689 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:54.450056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac7e7a-4b1e-4661-ae40-ae1fb38d1689 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:54.450456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac7e7a-4b1e-4661-ae40-ae1fb38d1689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:54.459733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac7e7a-4b1e-4661-ae40-ae1fb38d1689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:54.461464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac7e7a-4b1e-4661-ae40-ae1fb38d1689 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:54.474068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1205/2386] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:54.496120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894d037-4d90-4130-884b-c7da3e788607 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:54.577271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894d037-4d90-4130-884b-c7da3e788607 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:54.583260 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:54.584186 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:54.586577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:54.586577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] PATH_INFO: `/v3/users/f963d9356ccb4e548084605fbe82e6aa` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:54.586577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f963d9356ccb4e548084605fbe82e6aa)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:54.588085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:54.807038 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f963d9356ccb4e548084605fbe82e6aa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:54.818571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f963d9356ccb4e548084605fbe82e6aa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:54.819504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f963d9356ccb4e548084605fbe82e6aa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:54.836953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f963d9356ccb4e548084605fbe82e6aa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:54.838036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f963d9356ccb4e548084605fbe82e6aa'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:54.937175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1182/2387] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:10:54 2022] DELETE /identity/v3/users/f963d9356ccb4e548084605fbe82e6aa => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:54.941023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5c5a-6347-48f5-a8d3-74637aaa0f8b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:54.941964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5c5a-6347-48f5-a8d3-74637aaa0f8b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:54.942503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5c5a-6347-48f5-a8d3-74637aaa0f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:54.963189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-a75e5c5a-6347-48f5-a8d3-74637aaa0f8b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:54.964883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a75e5c5a-6347-48f5-a8d3-74637aaa0f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:55.131148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:55.132636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:55.142851 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1206/2388] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:10:55.230362 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc6de-720f-4ef7-97d0-f0db4664a4d3 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:55.234193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97127d-b737-49e3-9d72-e873ef8cf184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:55.235605 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97127d-b737-49e3-9d72-e873ef8cf184 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:55.241599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97127d-b737-49e3-9d72-e873ef8cf184 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:55.241599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97127d-b737-49e3-9d72-e873ef8cf184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:55.247287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97127d-b737-49e3-9d72-e873ef8cf184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:55.248870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97127d-b737-49e3-9d72-e873ef8cf184 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:55.271130 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1183/2389] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:10:55.775162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e5c5a-6347-48f5-a8d3-74637aaa0f8b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:55.776674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a75e5c5a-6347-48f5-a8d3-74637aaa0f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:55.792080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:55.798183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e5c5a-6347-48f5-a8d3-74637aaa0f8b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:55.809077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:55.810061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:55.810271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:55.810548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] PATH_INFO: `/v3/projects/c4599a7498da4eaaba5d8b1c3bcf8e54` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:55.811886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4599a7498da4eaaba5d8b1c3bcf8e54)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:55.814623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:55.956392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4599a7498da4eaaba5d8b1c3bcf8e54', 'request_id': 'req-7cb49c86-1c47-4dec-8ff5-8993d34160cd'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:55.964131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4599a7498da4eaaba5d8b1c3bcf8e54', 'request_id': 'req-7cb49c86-1c47-4dec-8ff5-8993d34160cd'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:55.970698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4599a7498da4eaaba5d8b1c3bcf8e54', 'request_id': 'req-7cb49c86-1c47-4dec-8ff5-8993d34160cd'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:56.058134 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] The token cache is being invalidate because project c4599a7498da4eaaba5d8b1c3bcf8e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:10:56.058617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:56.059090 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7cb49c86-1c47-4dec-8ff5-8993d34160cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:10:56.060949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1207/2390] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:10:55 2022] DELETE /identity/v3/projects/c4599a7498da4eaaba5d8b1c3bcf8e54 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:56.065843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b48cb6-8977-4cfa-9337-8f288529e73f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:56.066689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b48cb6-8977-4cfa-9337-8f288529e73f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:56.070512 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b48cb6-8977-4cfa-9337-8f288529e73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:56.095281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-93b48cb6-8977-4cfa-9337-8f288529e73f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:56.095672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-93b48cb6-8977-4cfa-9337-8f288529e73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:56.100643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:10:56.172728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1184/2391] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:56.191773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a45b-6775-4788-9518-c9c3f52c1a3d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:56.191773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a45b-6775-4788-9518-c9c3f52c1a3d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:56.191773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a45b-6775-4788-9518-c9c3f52c1a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:56.209367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-ece8a45b-6775-4788-9518-c9c3f52c1a3d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:56.210238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ece8a45b-6775-4788-9518-c9c3f52c1a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:56.223617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1208/2392] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:10:56.226279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b48cb6-8977-4cfa-9337-8f288529e73f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:56.241078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b48cb6-8977-4cfa-9337-8f288529e73f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:56.247179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784c54d-9392-4f32-83fd-f88465aea27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:56.247917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784c54d-9392-4f32-83fd-f88465aea27e admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:56.248227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784c54d-9392-4f32-83fd-f88465aea27e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:56.254524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784c54d-9392-4f32-83fd-f88465aea27e admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:56.254524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784c54d-9392-4f32-83fd-f88465aea27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:10:56.254524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784c54d-9392-4f32-83fd-f88465aea27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:56.254524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784c54d-9392-4f32-83fd-f88465aea27e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:56.272027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1185/2393] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:10:56.276223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8a45b-6775-4788-9518-c9c3f52c1a3d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:56.293577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8a45b-6775-4788-9518-c9c3f52c1a3d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:56.311331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be0aa-7dda-498d-9790-cac529b0a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:56.311331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be0aa-7dda-498d-9790-cac529b0a537 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:56.311331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be0aa-7dda-498d-9790-cac529b0a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:56.312305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be0aa-7dda-498d-9790-cac529b0a537 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:56.313576 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04be0aa-7dda-498d-9790-cac529b0a537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:56.317600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04be0aa-7dda-498d-9790-cac529b0a537 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:56.703599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1209/2394] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:10:56 2022] POST /identity/v3/projects => generated 375 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:10:56.707986 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784c54d-9392-4f32-83fd-f88465aea27e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:56.719115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784c54d-9392-4f32-83fd-f88465aea27e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:56.776240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267c9a-1381-45a5-87ce-3d079ae03a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:56.776902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267c9a-1381-45a5-87ce-3d079ae03a5a admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:56.777187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267c9a-1381-45a5-87ce-3d079ae03a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:56.777465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267c9a-1381-45a5-87ce-3d079ae03a5a admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:56.778158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa267c9a-1381-45a5-87ce-3d079ae03a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:56.780120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa267c9a-1381-45a5-87ce-3d079ae03a5a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:56.968496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1186/2395] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:10:56 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:10:56.971940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be0aa-7dda-498d-9790-cac529b0a537 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:56.991416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be0aa-7dda-498d-9790-cac529b0a537 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:57.005667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf8fe-785c-451b-b9b6-bef62a23ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:57.006717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf8fe-785c-451b-b9b6-bef62a23ff1a admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:57.007210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf8fe-785c-451b-b9b6-bef62a23ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:57.007735 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf8fe-785c-451b-b9b6-bef62a23ff1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:57.009225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edf8fe-785c-451b-b9b6-bef62a23ff1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:57.011841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edf8fe-785c-451b-b9b6-bef62a23ff1a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:57.025585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1210/2396] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:57.039630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267c9a-1381-45a5-87ce-3d079ae03a5a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:57.050035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267c9a-1381-45a5-87ce-3d079ae03a5a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:57.055153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d61b-115b-4f7a-9583-18996940d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:57.055943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d61b-115b-4f7a-9583-18996940d198 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:57.056238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d61b-115b-4f7a-9583-18996940d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:57.056539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d61b-115b-4f7a-9583-18996940d198 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:57.057281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46d61b-115b-4f7a-9583-18996940d198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:57.058941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46d61b-115b-4f7a-9583-18996940d198 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:57.072557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1187/2397] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:10:57.076707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf8fe-785c-451b-b9b6-bef62a23ff1a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:57.087338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf8fe-785c-451b-b9b6-bef62a23ff1a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:57.092483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7913f0-ffb8-4785-a9ad-960163d04996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:57.093788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7913f0-ffb8-4785-a9ad-960163d04996 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:57.093788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7913f0-ffb8-4785-a9ad-960163d04996 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:57.093966 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7913f0-ffb8-4785-a9ad-960163d04996 admin admin] PATH_INFO: `/v3/projects/68e942a3edec4db790d6377fe370b1ab/users/854cfb01a86d4e7fadb53496acf88306/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:57.122374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7913f0-ffb8-4785-a9ad-960163d04996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e942a3edec4db790d6377fe370b1ab, user_id=854cfb01a86d4e7fadb53496acf88306, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:57.125202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7913f0-ffb8-4785-a9ad-960163d04996 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:57.248575 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1211/2398] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:10:57 2022] PUT /identity/v3/projects/68e942a3edec4db790d6377fe370b1ab/users/854cfb01a86d4e7fadb53496acf88306/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:10:57.259041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4092-2dd6-4dca-a586-5a6420f2ff55 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:57.260097 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4092-2dd6-4dca-a586-5a6420f2ff55 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:57.260604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4092-2dd6-4dca-a586-5a6420f2ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:57.314490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-439f4092-2dd6-4dca-a586-5a6420f2ff55 None None] MFA Rules not processed for user `854cfb01a86d4e7fadb53496acf88306`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:10:57.317063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-439f4092-2dd6-4dca-a586-5a6420f2ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:57.416834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1188/2399] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:10:57.431241 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7913f0-ffb8-4785-a9ad-960163d04996 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:10:57.433065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1f7913f0-ffb8-4785-a9ad-960163d04996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:10:57.520725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7913f0-ffb8-4785-a9ad-960163d04996 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:10:57.527229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef75fdf-1c82-49bc-b896-fd15ef4a417b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4145a3bf87a94f4e9d39e16dc483595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:10:57.528050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef75fdf-1c82-49bc-b896-fd15ef4a417b service glance] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:10:57.528398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef75fdf-1c82-49bc-b896-fd15ef4a417b service glance] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:10:57.528615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef75fdf-1c82-49bc-b896-fd15ef4a417b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:10:57.539046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef75fdf-1c82-49bc-b896-fd15ef4a417b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:10:57.540594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef75fdf-1c82-49bc-b896-fd15ef4a417b service glance] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:10:57.554713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1212/2400] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:10:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:04.200529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f4092-2dd6-4dca-a586-5a6420f2ff55 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:04.207688 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-439f4092-2dd6-4dca-a586-5a6420f2ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:04.210513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:04.274503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f4092-2dd6-4dca-a586-5a6420f2ff55 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:04.279093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:04.279988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:04.280303 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:04.280585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] PATH_INFO: `/v3/users/042d0ce221304bd58a6fa4bac2ba365b` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:04.281842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=042d0ce221304bd58a6fa4bac2ba365b)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:04.283949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:04.551150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042d0ce221304bd58a6fa4bac2ba365b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:04.558992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042d0ce221304bd58a6fa4bac2ba365b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:04.559761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042d0ce221304bd58a6fa4bac2ba365b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:04.572766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042d0ce221304bd58a6fa4bac2ba365b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:04.573964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042d0ce221304bd58a6fa4bac2ba365b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:04.728808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1189/2401] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:04 2022] DELETE /identity/v3/users/042d0ce221304bd58a6fa4bac2ba365b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:05.075764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef75fdf-1c82-49bc-b896-fd15ef4a417b service glance] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:05.084120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef75fdf-1c82-49bc-b896-fd15ef4a417b service glance] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:05.122072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:05.200056 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:05.200783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:05.207958 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:05.208457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] PATH_INFO: `/v3/projects/31474d84c380464d8312ab335d7359a6` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:05.214823 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31474d84c380464d8312ab335d7359a6)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:05.216799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:05.394682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31474d84c380464d8312ab335d7359a6', 'request_id': 'req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:05.403657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31474d84c380464d8312ab335d7359a6', 'request_id': 'req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:05.408239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31474d84c380464d8312ab335d7359a6', 'request_id': 'req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:05.487577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] The token cache is being invalidate because project 31474d84c380464d8312ab335d7359a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:05.487916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:05.489152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e3ebfdf7-bd33-4a26-abbe-ccbcac1fa6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:05.492042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1213/2402] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:05 2022] DELETE /identity/v3/projects/31474d84c380464d8312ab335d7359a6 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:09.285531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:09.286973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:09.347132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75948ff3-6616-40c7-84ed-76b55ee6e9fe admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:09.393309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:09.412305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:09.412963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:09.413268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:09.413870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:09.415499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:09.487063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:09.488518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:09.499106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1190/2403] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:09.591712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3914f0-4012-4fe0-a448-aa53b6fc11a5 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:09.592493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3914f0-4012-4fe0-a448-aa53b6fc11a5 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:09.592598 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3914f0-4012-4fe0-a448-aa53b6fc11a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:09.611898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-bd3914f0-4012-4fe0-a448-aa53b6fc11a5 None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:09.613734 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bd3914f0-4012-4fe0-a448-aa53b6fc11a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:09.678155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1214/2404] 10.222.0.93 () {58 vars in 1009 bytes} [Thu May 26 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:09.690910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:09.692503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:09.773811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6f090-5920-4488-b864-575e44e820c8 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:09.779131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f598e-9709-49fd-8005-3aee489d968e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:09.779814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f598e-9709-49fd-8005-3aee489d968e service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:09.780096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f598e-9709-49fd-8005-3aee489d968e service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:09.780369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f598e-9709-49fd-8005-3aee489d968e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:09.789628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f598e-9709-49fd-8005-3aee489d968e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:09.791535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f598e-9709-49fd-8005-3aee489d968e service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:09.802878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1191/2405] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:11:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:11:13.868792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3914f0-4012-4fe0-a448-aa53b6fc11a5 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:13.871062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bd3914f0-4012-4fe0-a448-aa53b6fc11a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:13.894176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3914f0-4012-4fe0-a448-aa53b6fc11a5 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:13.903350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:13.904779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:13.905632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:13.906127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] PATH_INFO: `/v3/users/7f8a3035f5c54f3d84e2a81240a9306f` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:13.908800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8a3035f5c54f3d84e2a81240a9306f)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:13.914640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:14.102149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8a3035f5c54f3d84e2a81240a9306f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:14.345182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8a3035f5c54f3d84e2a81240a9306f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:14.348144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:14.371040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8a3035f5c54f3d84e2a81240a9306f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:14.397748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8a3035f5c54f3d84e2a81240a9306f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:14.398574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-42281f66-8ed2-4c7a-a73d-aad61c458009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8a3035f5c54f3d84e2a81240a9306f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:14.406085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1215/2406] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:13 2022] DELETE /identity/v3/users/7f8a3035f5c54f3d84e2a81240a9306f => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:14.739012 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f598e-9709-49fd-8005-3aee489d968e service swift] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:14.754891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f598e-9709-49fd-8005-3aee489d968e service swift] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:14.838761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:14.839694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:14.839979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:14.840254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] PATH_INFO: `/v3/projects/60b5f8bc33a8482a8326b44b42fb7e4d` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:14.841641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b5f8bc33a8482a8326b44b42fb7e4d)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:14.860229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:14.888016 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:15.002217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b5f8bc33a8482a8326b44b42fb7e4d', 'request_id': 'req-2c18116a-a40c-4283-815f-9fcd76650488'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:15.009383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b5f8bc33a8482a8326b44b42fb7e4d', 'request_id': 'req-2c18116a-a40c-4283-815f-9fcd76650488'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:15.028472 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b5f8bc33a8482a8326b44b42fb7e4d', 'request_id': 'req-2c18116a-a40c-4283-815f-9fcd76650488'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:15.165617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] The token cache is being invalidate because project 60b5f8bc33a8482a8326b44b42fb7e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:15.165914 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:15.166594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2c18116a-a40c-4283-815f-9fcd76650488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:15.174425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1192/2407] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:14 2022] DELETE /identity/v3/projects/60b5f8bc33a8482a8326b44b42fb7e4d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:15.179515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b8d19-c859-4272-880f-a2c4a032a0d8 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.180409 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b8d19-c859-4272-880f-a2c4a032a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.180690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b8d19-c859-4272-880f-a2c4a032a0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.200589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-949b8d19-c859-4272-880f-a2c4a032a0d8 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:15.201982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-949b8d19-c859-4272-880f-a2c4a032a0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:15.315067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1216/2408] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:15.316788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5249e43-c6a6-48e7-8175-5d87f9f890ba None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.317180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5249e43-c6a6-48e7-8175-5d87f9f890ba None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.317559 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5249e43-c6a6-48e7-8175-5d87f9f890ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.337295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c5249e43-c6a6-48e7-8175-5d87f9f890ba None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:15.344995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c5249e43-c6a6-48e7-8175-5d87f9f890ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:15.354995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1193/2409] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:15.356496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b8d19-c859-4272-880f-a2c4a032a0d8 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.368176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b8d19-c859-4272-880f-a2c4a032a0d8 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.384238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc67f6-cfa6-4277-82ec-3278314e0350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.384238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc67f6-cfa6-4277-82ec-3278314e0350 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.384238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc67f6-cfa6-4277-82ec-3278314e0350 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.384238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc67f6-cfa6-4277-82ec-3278314e0350 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.384738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc67f6-cfa6-4277-82ec-3278314e0350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:15.384738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc67f6-cfa6-4277-82ec-3278314e0350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.384738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc67f6-cfa6-4277-82ec-3278314e0350 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.399419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1217/2410] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:11:15.403776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5249e43-c6a6-48e7-8175-5d87f9f890ba None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.413728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5249e43-c6a6-48e7-8175-5d87f9f890ba None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.420098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38638f4-311e-42dc-9976-1a91e461c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.420849 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38638f4-311e-42dc-9976-1a91e461c69b admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.421133 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38638f4-311e-42dc-9976-1a91e461c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.421410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38638f4-311e-42dc-9976-1a91e461c69b admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.422122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38638f4-311e-42dc-9976-1a91e461c69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.424268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38638f4-311e-42dc-9976-1a91e461c69b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.565247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1194/2411] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:15 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:15.566249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc67f6-cfa6-4277-82ec-3278314e0350 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.580688 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc67f6-cfa6-4277-82ec-3278314e0350 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.661461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac6d9-7354-4869-98fa-fa6c80d22d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.662218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac6d9-7354-4869-98fa-fa6c80d22d96 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.662496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac6d9-7354-4869-98fa-fa6c80d22d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.662852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac6d9-7354-4869-98fa-fa6c80d22d96 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.663692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac6d9-7354-4869-98fa-fa6c80d22d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.666202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac6d9-7354-4869-98fa-fa6c80d22d96 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.787388 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1218/2412] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:15 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:15.791233 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38638f4-311e-42dc-9976-1a91e461c69b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.804947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38638f4-311e-42dc-9976-1a91e461c69b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.809827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ddac-8bda-4914-b257-394bb43f97a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.810503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ddac-8bda-4914-b257-394bb43f97a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.810783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ddac-8bda-4914-b257-394bb43f97a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.811121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ddac-8bda-4914-b257-394bb43f97a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.811827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0ddac-8bda-4914-b257-394bb43f97a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.813488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0ddac-8bda-4914-b257-394bb43f97a8 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.826075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1195/2413] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:15.829776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac6d9-7354-4869-98fa-fa6c80d22d96 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.841063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac6d9-7354-4869-98fa-fa6c80d22d96 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.847005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b801b-bdce-4ba9-bfbf-ba4990036036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.849078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b801b-bdce-4ba9-bfbf-ba4990036036 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.849589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b801b-bdce-4ba9-bfbf-ba4990036036 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.850025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b801b-bdce-4ba9-bfbf-ba4990036036 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.850921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b801b-bdce-4ba9-bfbf-ba4990036036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.853353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b801b-bdce-4ba9-bfbf-ba4990036036 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.866390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1219/2414] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:11:15.870279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ddac-8bda-4914-b257-394bb43f97a8 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.882787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ddac-8bda-4914-b257-394bb43f97a8 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.887864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218410d-5a3c-4c2a-ba7c-ee667a0de301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.888752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218410d-5a3c-4c2a-ba7c-ee667a0de301 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.889033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218410d-5a3c-4c2a-ba7c-ee667a0de301 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.889306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218410d-5a3c-4c2a-ba7c-ee667a0de301 admin admin] PATH_INFO: `/v3/projects/57befe947ad74aa493a76a9c1478b7e0/users/68e5b48c8d804399bc3c3b8d026e09b9/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.909160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218410d-5a3c-4c2a-ba7c-ee667a0de301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57befe947ad74aa493a76a9c1478b7e0, user_id=68e5b48c8d804399bc3c3b8d026e09b9, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.913607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218410d-5a3c-4c2a-ba7c-ee667a0de301 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:15.950950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b801b-bdce-4ba9-bfbf-ba4990036036 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:15.952922 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d97b801b-bdce-4ba9-bfbf-ba4990036036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:15.966989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b801b-bdce-4ba9-bfbf-ba4990036036 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:15.973809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:15.973809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:15.973809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:15.974212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] PATH_INFO: `/v3/users/854cfb01a86d4e7fadb53496acf88306` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:15.975383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=854cfb01a86d4e7fadb53496acf88306)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:15.977423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:16.008030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1196/2415] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:15 2022] PUT /identity/v3/projects/57befe947ad74aa493a76a9c1478b7e0/users/68e5b48c8d804399bc3c3b8d026e09b9/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:16.021007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c581b-021c-4448-9f9a-bc194f01ccff None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:16.021300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c581b-021c-4448-9f9a-bc194f01ccff None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:16.021677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c581b-021c-4448-9f9a-bc194f01ccff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:16.052420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-531c581b-021c-4448-9f9a-bc194f01ccff None None] MFA Rules not processed for user `68e5b48c8d804399bc3c3b8d026e09b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:16.053845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-531c581b-021c-4448-9f9a-bc194f01ccff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:16.132748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1197/2416] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:16.137755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c581b-021c-4448-9f9a-bc194f01ccff None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:16.186572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:16.216628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:16.226441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c581b-021c-4448-9f9a-bc194f01ccff None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:16.228084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854cfb01a86d4e7fadb53496acf88306'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:16.231838 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f8ce3-7e52-4f9a-8b76-c3b69a6672bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:16.232494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8ce3-7e52-4f9a-8b76-c3b69a6672bc admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:16.232796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8ce3-7e52-4f9a-8b76-c3b69a6672bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:16.233086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8ce3-7e52-4f9a-8b76-c3b69a6672bc admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:16.233776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f8ce3-7e52-4f9a-8b76-c3b69a6672bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:16.235749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f8ce3-7e52-4f9a-8b76-c3b69a6672bc admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:16.333692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854cfb01a86d4e7fadb53496acf88306'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:16.341907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854cfb01a86d4e7fadb53496acf88306'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:16.345678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1198/2417] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:16 2022] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:11:16.349621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f8ce3-7e52-4f9a-8b76-c3b69a6672bc admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:16.359684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854cfb01a86d4e7fadb53496acf88306'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:16.360444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-21a428fc-c508-412d-9fbb-fbef5006cb3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854cfb01a86d4e7fadb53496acf88306'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:16.368552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1220/2418] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:15 2022] DELETE /identity/v3/users/854cfb01a86d4e7fadb53496acf88306 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:16.374585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dbe9a-26e3-4a2d-991e-aec48677cea1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:16.374875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dbe9a-26e3-4a2d-991e-aec48677cea1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:16.375696 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dbe9a-26e3-4a2d-991e-aec48677cea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:16.419423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-a74dbe9a-26e3-4a2d-991e-aec48677cea1 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:16.420859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a74dbe9a-26e3-4a2d-991e-aec48677cea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:16.467802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f8ce3-7e52-4f9a-8b76-c3b69a6672bc admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:16.555173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1221/2419] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:16.582296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dbe9a-26e3-4a2d-991e-aec48677cea1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:16.583809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a74dbe9a-26e3-4a2d-991e-aec48677cea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:16.624108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b97d9-66d6-422c-a4de-aaeef285e0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:16.624978 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b97d9-66d6-422c-a4de-aaeef285e0ae admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:16.625350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b97d9-66d6-422c-a4de-aaeef285e0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:16.625690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b97d9-66d6-422c-a4de-aaeef285e0ae admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:16.626629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b97d9-66d6-422c-a4de-aaeef285e0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:16.629571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b97d9-66d6-422c-a4de-aaeef285e0ae admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:16.699647 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dbe9a-26e3-4a2d-991e-aec48677cea1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:16.704011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514cb1-1e74-44ab-a1b3-da76522354f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:16.704785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514cb1-1e74-44ab-a1b3-da76522354f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:16.705170 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514cb1-1e74-44ab-a1b3-da76522354f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:16.705555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514cb1-1e74-44ab-a1b3-da76522354f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:16.717638 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76514cb1-1e74-44ab-a1b3-da76522354f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:16.719148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76514cb1-1e74-44ab-a1b3-da76522354f6 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:16.735668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1222/2420] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:16.759812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1199/2421] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:16 2022] POST /identity/v3/users => generated 292 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:16.762131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514cb1-1e74-44ab-a1b3-da76522354f6 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:16.763552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-76514cb1-1e74-44ab-a1b3-da76522354f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:16.793032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514cb1-1e74-44ab-a1b3-da76522354f6 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:16.799013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8755-7748-46b2-8e70-e90426554e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:16.799747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8755-7748-46b2-8e70-e90426554e39 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:16.801080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8755-7748-46b2-8e70-e90426554e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:16.801080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8755-7748-46b2-8e70-e90426554e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:16.801712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe8755-7748-46b2-8e70-e90426554e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:16.803454 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe8755-7748-46b2-8e70-e90426554e39 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:16.815510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1223/2422] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:16.819597 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b97d9-66d6-422c-a4de-aaeef285e0ae admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:16.831553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b97d9-66d6-422c-a4de-aaeef285e0ae admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:16.837785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9bc2a-d438-41fd-abcc-568a22607146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:16.838900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9bc2a-d438-41fd-abcc-568a22607146 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:16.839408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9bc2a-d438-41fd-abcc-568a22607146 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:16.839891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9bc2a-d438-41fd-abcc-568a22607146 admin admin] PATH_INFO: `/v3/projects/5327ec738b4848ec9780cd6b948715a4/users/87e7e674cc544beabf7b635991552aff/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:16.858458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9bc2a-d438-41fd-abcc-568a22607146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5327ec738b4848ec9780cd6b948715a4, user_id=87e7e674cc544beabf7b635991552aff, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:16.861232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9bc2a-d438-41fd-abcc-568a22607146 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:16.983682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1200/2423] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:16 2022] PUT /identity/v3/projects/5327ec738b4848ec9780cd6b948715a4/users/87e7e674cc544beabf7b635991552aff/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:16.987420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8755-7748-46b2-8e70-e90426554e39 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:17.000464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8755-7748-46b2-8e70-e90426554e39 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:17.089783 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:17.103994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6eb56-3b7a-4330-8931-f7b1fd3250f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:17.104818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6eb56-3b7a-4330-8931-f7b1fd3250f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:17.105105 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6eb56-3b7a-4330-8931-f7b1fd3250f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:17.105383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6eb56-3b7a-4330-8931-f7b1fd3250f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:17.106113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6eb56-3b7a-4330-8931-f7b1fd3250f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:17.107746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6eb56-3b7a-4330-8931-f7b1fd3250f0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:17.119900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1224/2424] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:17.124238 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9bc2a-d438-41fd-abcc-568a22607146 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:17.136647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9bc2a-d438-41fd-abcc-568a22607146 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:17.146823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b13219-9953-4dce-ae23-3cff048680c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:17.146823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b13219-9953-4dce-ae23-3cff048680c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:17.147179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b13219-9953-4dce-ae23-3cff048680c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:17.147179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b13219-9953-4dce-ae23-3cff048680c6 admin admin] PATH_INFO: `/v3/projects/5327ec738b4848ec9780cd6b948715a4/users/87e7e674cc544beabf7b635991552aff/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:17.149805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b13219-9953-4dce-ae23-3cff048680c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5327ec738b4848ec9780cd6b948715a4, user_id=87e7e674cc544beabf7b635991552aff, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:17.152214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b13219-9953-4dce-ae23-3cff048680c6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:17.171905 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1201/2425] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:17 2022] PUT /identity/v3/projects/5327ec738b4848ec9780cd6b948715a4/users/87e7e674cc544beabf7b635991552aff/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:17.180544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9567af8-795d-4a23-9210-6eb26cdb10b8 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:17.180544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9567af8-795d-4a23-9210-6eb26cdb10b8 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:17.180544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9567af8-795d-4a23-9210-6eb26cdb10b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:17.208869 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-a9567af8-795d-4a23-9210-6eb26cdb10b8 None None] MFA Rules not processed for user `87e7e674cc544beabf7b635991552aff`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:17.220845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a9567af8-795d-4a23-9210-6eb26cdb10b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:17.294301 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1225/2426] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:17.309418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b13219-9953-4dce-ae23-3cff048680c6 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:17.311336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d1b13219-9953-4dce-ae23-3cff048680c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:17.341198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:17.377219 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9567af8-795d-4a23-9210-6eb26cdb10b8 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:17.393171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a9567af8-795d-4a23-9210-6eb26cdb10b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:17.407239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b13219-9953-4dce-ae23-3cff048680c6 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:17.416310 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4826608-a212-4081-a92d-975afb059875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:17.417164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4826608-a212-4081-a92d-975afb059875 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:17.417444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4826608-a212-4081-a92d-975afb059875 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:17.417855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4826608-a212-4081-a92d-975afb059875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:17.447626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4826608-a212-4081-a92d-975afb059875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:17.449441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4826608-a212-4081-a92d-975afb059875 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:17.475895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1202/2427] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:17.495336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9567af8-795d-4a23-9210-6eb26cdb10b8 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:17.510423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:17.511910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:17.512479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:17.512769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] PATH_INFO: `/v3/projects/68e942a3edec4db790d6377fe370b1ab` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:17.514687 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e942a3edec4db790d6377fe370b1ab)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:17.517161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:18.026465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e942a3edec4db790d6377fe370b1ab', 'request_id': 'req-659b9d53-a582-43a2-90d5-279f7994f459'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:18.028404 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4826608-a212-4081-a92d-975afb059875 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:18.033542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e942a3edec4db790d6377fe370b1ab', 'request_id': 'req-659b9d53-a582-43a2-90d5-279f7994f459'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:18.037345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4826608-a212-4081-a92d-975afb059875 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:18.039942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e942a3edec4db790d6377fe370b1ab', 'request_id': 'req-659b9d53-a582-43a2-90d5-279f7994f459'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:18.084727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:18.096505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16a7d8-0dca-4d93-89f2-efc8f184e87c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:18.097909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16a7d8-0dca-4d93-89f2-efc8f184e87c service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.098251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16a7d8-0dca-4d93-89f2-efc8f184e87c service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.098540 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16a7d8-0dca-4d93-89f2-efc8f184e87c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.100422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ec16a7d8-0dca-4d93-89f2-efc8f184e87c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:18.118468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] The token cache is being invalidate because project 68e942a3edec4db790d6377fe370b1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:18.122730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:18.122730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-659b9d53-a582-43a2-90d5-279f7994f459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:18.122730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1226/2428] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:17 2022] DELETE /identity/v3/projects/68e942a3edec4db790d6377fe370b1ab => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:18.125967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c888b6-5aff-40ce-a565-6bd38cacbe49 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.126372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c888b6-5aff-40ce-a565-6bd38cacbe49 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.126762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c888b6-5aff-40ce-a565-6bd38cacbe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.146391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-70c888b6-5aff-40ce-a565-6bd38cacbe49 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:18.147961 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-70c888b6-5aff-40ce-a565-6bd38cacbe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:18.167348 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16a7d8-0dca-4d93-89f2-efc8f184e87c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:18.169121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16a7d8-0dca-4d93-89f2-efc8f184e87c service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:18.178875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1203/2429] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:11:18.217023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1227/2430] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:18.225103 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e697-2af5-4422-8fe2-f574810b09fc None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.225393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e697-2af5-4422-8fe2-f574810b09fc None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.225669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e697-2af5-4422-8fe2-f574810b09fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.244058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5856e697-2af5-4422-8fe2-f574810b09fc None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:18.245274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5856e697-2af5-4422-8fe2-f574810b09fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:18.255118 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1204/2431] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:18.259411 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c888b6-5aff-40ce-a565-6bd38cacbe49 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:18.269971 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c888b6-5aff-40ce-a565-6bd38cacbe49 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:18.274860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057b765-925a-427c-877d-fcd939f071ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:18.280293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057b765-925a-427c-877d-fcd939f071ae admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.280293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057b765-925a-427c-877d-fcd939f071ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.280293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057b765-925a-427c-877d-fcd939f071ae admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.280293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057b765-925a-427c-877d-fcd939f071ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:18.280293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057b765-925a-427c-877d-fcd939f071ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:18.280293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057b765-925a-427c-877d-fcd939f071ae admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:18.291624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1228/2432] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:11:18.295681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856e697-2af5-4422-8fe2-f574810b09fc None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:18.305414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856e697-2af5-4422-8fe2-f574810b09fc None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:18.313093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d124-a390-47d8-82c0-b2f8114fa4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:18.313093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d124-a390-47d8-82c0-b2f8114fa4ac admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.313093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d124-a390-47d8-82c0-b2f8114fa4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.313093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d124-a390-47d8-82c0-b2f8114fa4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.313558 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d124-a390-47d8-82c0-b2f8114fa4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:18.314125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d124-a390-47d8-82c0-b2f8114fa4ac admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:18.427362 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1205/2433] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:18 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:18.431492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057b765-925a-427c-877d-fcd939f071ae admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:18.442236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057b765-925a-427c-877d-fcd939f071ae admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:18.502951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d97b7d-3d58-4848-b13d-fec8c0072040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:18.504314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d97b7d-3d58-4848-b13d-fec8c0072040 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.508108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d97b7d-3d58-4848-b13d-fec8c0072040 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.508108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d97b7d-3d58-4848-b13d-fec8c0072040 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.508108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d97b7d-3d58-4848-b13d-fec8c0072040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:18.508108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d97b7d-3d58-4848-b13d-fec8c0072040 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:18.608706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1229/2434] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:18 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:18.612577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d124-a390-47d8-82c0-b2f8114fa4ac admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:18.624785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d124-a390-47d8-82c0-b2f8114fa4ac admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:18.632142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c493-fefd-4acd-a927-5090e02e7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:18.632968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c493-fefd-4acd-a927-5090e02e7036 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.633395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c493-fefd-4acd-a927-5090e02e7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.633534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c493-fefd-4acd-a927-5090e02e7036 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.634263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4c493-fefd-4acd-a927-5090e02e7036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:18.637080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4c493-fefd-4acd-a927-5090e02e7036 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:18.647964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1206/2435] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:18.652001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d97b7d-3d58-4848-b13d-fec8c0072040 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:18.662195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d97b7d-3d58-4848-b13d-fec8c0072040 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:18.666910 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4774d2-3470-42ff-9b53-dc82382d156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:18.667555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4774d2-3470-42ff-9b53-dc82382d156e admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.667869 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4774d2-3470-42ff-9b53-dc82382d156e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.668143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4774d2-3470-42ff-9b53-dc82382d156e admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.668888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4774d2-3470-42ff-9b53-dc82382d156e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:18.670447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4774d2-3470-42ff-9b53-dc82382d156e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:18.681698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1230/2436] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:18.685928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c493-fefd-4acd-a927-5090e02e7036 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:18.697383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c493-fefd-4acd-a927-5090e02e7036 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:18.702167 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb2514-e66d-4cd9-b5e8-ae83f5e52d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:18.703063 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb2514-e66d-4cd9-b5e8-ae83f5e52d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.703350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb2514-e66d-4cd9-b5e8-ae83f5e52d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.703670 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb2514-e66d-4cd9-b5e8-ae83f5e52d2c admin admin] PATH_INFO: `/v3/projects/2880c24f33e54c0395e029257f566ff7/users/06e47f406abb456aa69613c80f20172d/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.720499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb2514-e66d-4cd9-b5e8-ae83f5e52d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2880c24f33e54c0395e029257f566ff7, user_id=06e47f406abb456aa69613c80f20172d, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:18.722034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb2514-e66d-4cd9-b5e8-ae83f5e52d2c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:18.803121 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1207/2437] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:18 2022] PUT /identity/v3/projects/2880c24f33e54c0395e029257f566ff7/users/06e47f406abb456aa69613c80f20172d/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:18.814230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929e26-aa33-40ce-bcfb-b44e44a01fd8 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.814521 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929e26-aa33-40ce-bcfb-b44e44a01fd8 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.814824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929e26-aa33-40ce-bcfb-b44e44a01fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.843245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-59929e26-aa33-40ce-bcfb-b44e44a01fd8 None None] MFA Rules not processed for user `06e47f406abb456aa69613c80f20172d`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:18.844483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-59929e26-aa33-40ce-bcfb-b44e44a01fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:18.892151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:18.909163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1231/2438] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:18.914294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb2514-e66d-4cd9-b5e8-ae83f5e52d2c admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:18.928828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:18.990730 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb2514-e66d-4cd9-b5e8-ae83f5e52d2c admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:18.995441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527814c-7a98-49bd-a4cf-3bd9894de966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:18.996124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527814c-7a98-49bd-a4cf-3bd9894de966 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:18.996466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527814c-7a98-49bd-a4cf-3bd9894de966 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:18.996677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527814c-7a98-49bd-a4cf-3bd9894de966 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:18.997375 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527814c-7a98-49bd-a4cf-3bd9894de966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:18.999356 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527814c-7a98-49bd-a4cf-3bd9894de966 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:19.097972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1208/2439] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:18 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:19.102918 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929e26-aa33-40ce-bcfb-b44e44a01fd8 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:19.113682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929e26-aa33-40ce-bcfb-b44e44a01fd8 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:19.172881 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151675-f97d-4405-b778-0cd0d2cf5239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:19.173468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151675-f97d-4405-b778-0cd0d2cf5239 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:19.173752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151675-f97d-4405-b778-0cd0d2cf5239 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:19.174077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151675-f97d-4405-b778-0cd0d2cf5239 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:19.174709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43151675-f97d-4405-b778-0cd0d2cf5239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:19.176677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43151675-f97d-4405-b778-0cd0d2cf5239 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:19.311021 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1232/2440] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:19 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:19.316565 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527814c-7a98-49bd-a4cf-3bd9894de966 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:19.326332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527814c-7a98-49bd-a4cf-3bd9894de966 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:19.330836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a500c81-60e2-4de6-837d-eb3330a78e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:19.331485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a500c81-60e2-4de6-837d-eb3330a78e72 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:19.331831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a500c81-60e2-4de6-837d-eb3330a78e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:19.332111 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a500c81-60e2-4de6-837d-eb3330a78e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:19.332826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a500c81-60e2-4de6-837d-eb3330a78e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:19.334461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a500c81-60e2-4de6-837d-eb3330a78e72 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:19.348816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1209/2441] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:19.352876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151675-f97d-4405-b778-0cd0d2cf5239 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:19.363548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151675-f97d-4405-b778-0cd0d2cf5239 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:19.368168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229f22e-049a-4d12-aa43-c2b44fed0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:19.368816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229f22e-049a-4d12-aa43-c2b44fed0978 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:19.369101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229f22e-049a-4d12-aa43-c2b44fed0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:19.369387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229f22e-049a-4d12-aa43-c2b44fed0978 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:19.370085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229f22e-049a-4d12-aa43-c2b44fed0978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:19.371717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229f22e-049a-4d12-aa43-c2b44fed0978 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:19.382436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1233/2442] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:19.386529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a500c81-60e2-4de6-837d-eb3330a78e72 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:19.396463 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a500c81-60e2-4de6-837d-eb3330a78e72 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:19.401036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebb375-8176-4513-af1a-1c3e769e2ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:19.401901 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebb375-8176-4513-af1a-1c3e769e2ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:19.402184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebb375-8176-4513-af1a-1c3e769e2ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:19.402458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebb375-8176-4513-af1a-1c3e769e2ba7 admin admin] PATH_INFO: `/v3/projects/582fc07526e94c398fa05ce7d1b4eca4/users/8e9ce58498d24c1c9d97f8eb54dc4842/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:19.416602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebb375-8176-4513-af1a-1c3e769e2ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582fc07526e94c398fa05ce7d1b4eca4, user_id=8e9ce58498d24c1c9d97f8eb54dc4842, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:19.419244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebb375-8176-4513-af1a-1c3e769e2ba7 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:19.501305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1210/2443] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:19 2022] PUT /identity/v3/projects/582fc07526e94c398fa05ce7d1b4eca4/users/8e9ce58498d24c1c9d97f8eb54dc4842/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:19.512245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbdd75-0c01-4931-b37e-82b279c62919 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:19.514068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbdd75-0c01-4931-b37e-82b279c62919 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:19.514068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbdd75-0c01-4931-b37e-82b279c62919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:19.540439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3efbdd75-0c01-4931-b37e-82b279c62919 None None] MFA Rules not processed for user `8e9ce58498d24c1c9d97f8eb54dc4842`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:19.541657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3efbdd75-0c01-4931-b37e-82b279c62919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:19.612339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1234/2444] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:19.617332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebb375-8176-4513-af1a-1c3e769e2ba7 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:19.702767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebb375-8176-4513-af1a-1c3e769e2ba7 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:19.707777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ecd01-6d05-4bf1-aceb-d12977c9f122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:19.708469 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ecd01-6d05-4bf1-aceb-d12977c9f122 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:19.708719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ecd01-6d05-4bf1-aceb-d12977c9f122 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:19.709107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ecd01-6d05-4bf1-aceb-d12977c9f122 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:19.709804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ecd01-6d05-4bf1-aceb-d12977c9f122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:19.711748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ecd01-6d05-4bf1-aceb-d12977c9f122 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:19.810980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1211/2445] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:19 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:19.812907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbdd75-0c01-4931-b37e-82b279c62919 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:19.823095 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbdd75-0c01-4931-b37e-82b279c62919 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:19.885443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bdd5d-38b2-4a05-bbbe-0af13dd4bdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:19.886293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bdd5d-38b2-4a05-bbbe-0af13dd4bdde admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:19.887333 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bdd5d-38b2-4a05-bbbe-0af13dd4bdde admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:19.887333 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bdd5d-38b2-4a05-bbbe-0af13dd4bdde admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:19.887549 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bdd5d-38b2-4a05-bbbe-0af13dd4bdde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:19.889406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bdd5d-38b2-4a05-bbbe-0af13dd4bdde admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:19.896600 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:20.000685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1235/2446] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:19 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:20.004865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ecd01-6d05-4bf1-aceb-d12977c9f122 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:20.015365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ecd01-6d05-4bf1-aceb-d12977c9f122 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:20.020502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6828b-2771-4816-b240-2b498fc74977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:20.021158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6828b-2771-4816-b240-2b498fc74977 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:20.021443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6828b-2771-4816-b240-2b498fc74977 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:20.021722 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6828b-2771-4816-b240-2b498fc74977 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:20.022443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6828b-2771-4816-b240-2b498fc74977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:20.024092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6828b-2771-4816-b240-2b498fc74977 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:20.035382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1212/2447] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:11:20.039678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bdd5d-38b2-4a05-bbbe-0af13dd4bdde admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:20.050003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bdd5d-38b2-4a05-bbbe-0af13dd4bdde admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:20.059364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c184c-91a4-48c5-b116-ced7190be7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:20.060380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c184c-91a4-48c5-b116-ced7190be7be admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:20.060668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c184c-91a4-48c5-b116-ced7190be7be admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:20.060944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c184c-91a4-48c5-b116-ced7190be7be admin admin] PATH_INFO: `/v3/projects/457aa6b4804541f3a0919ee80d01abdf/users/03587c34416b408b87beb39ed5130344/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:20.076488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c184c-91a4-48c5-b116-ced7190be7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=457aa6b4804541f3a0919ee80d01abdf, user_id=03587c34416b408b87beb39ed5130344, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:20.079140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c184c-91a4-48c5-b116-ced7190be7be admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:20.337028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1236/2448] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:20 2022] PUT /identity/v3/projects/457aa6b4804541f3a0919ee80d01abdf/users/03587c34416b408b87beb39ed5130344/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:20.341122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6828b-2771-4816-b240-2b498fc74977 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:20.353252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6828b-2771-4816-b240-2b498fc74977 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:20.391694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:20.415813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ab114-71ba-443f-b931-f837d0d184f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:20.416498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab114-71ba-443f-b931-f837d0d184f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:20.416786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab114-71ba-443f-b931-f837d0d184f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:20.417069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab114-71ba-443f-b931-f837d0d184f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:20.417866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ab114-71ba-443f-b931-f837d0d184f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:20.419535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ab114-71ba-443f-b931-f837d0d184f8 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:20.430728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1213/2449] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:20.435968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c184c-91a4-48c5-b116-ced7190be7be admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:20.446487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c184c-91a4-48c5-b116-ced7190be7be admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:20.451101 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c36ac-709f-4b1f-b114-150a6e901744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:20.452178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c36ac-709f-4b1f-b114-150a6e901744 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:20.452455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c36ac-709f-4b1f-b114-150a6e901744 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:20.452724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c36ac-709f-4b1f-b114-150a6e901744 admin admin] PATH_INFO: `/v3/projects/457aa6b4804541f3a0919ee80d01abdf/users/03587c34416b408b87beb39ed5130344/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:20.454696 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c36ac-709f-4b1f-b114-150a6e901744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=457aa6b4804541f3a0919ee80d01abdf, user_id=03587c34416b408b87beb39ed5130344, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:20.457446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c36ac-709f-4b1f-b114-150a6e901744 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:20.469207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1237/2450] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:20 2022] PUT /identity/v3/projects/457aa6b4804541f3a0919ee80d01abdf/users/03587c34416b408b87beb39ed5130344/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:20.480207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4067fb-80f1-429e-b7e6-d188f299ad22 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:20.480503 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4067fb-80f1-429e-b7e6-d188f299ad22 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:20.480790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4067fb-80f1-429e-b7e6-d188f299ad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:20.508412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-cb4067fb-80f1-429e-b7e6-d188f299ad22 None None] MFA Rules not processed for user `03587c34416b408b87beb39ed5130344`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:20.509634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-cb4067fb-80f1-429e-b7e6-d188f299ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:20.585586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1214/2451] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:20.598096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c36ac-709f-4b1f-b114-150a6e901744 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:20.610467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-990c36ac-709f-4b1f-b114-150a6e901744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:20.664975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c36ac-709f-4b1f-b114-150a6e901744 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:20.671092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ce92c-73e3-4515-b3b8-3ddeb8aef371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:20.671092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ce92c-73e3-4515-b3b8-3ddeb8aef371 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:20.671092 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ce92c-73e3-4515-b3b8-3ddeb8aef371 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:20.671478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ce92c-73e3-4515-b3b8-3ddeb8aef371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:20.760616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ce92c-73e3-4515-b3b8-3ddeb8aef371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:20.762670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ce92c-73e3-4515-b3b8-3ddeb8aef371 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:20.773861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1238/2452] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:23.588471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4067fb-80f1-429e-b7e6-d188f299ad22 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:23.590377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-cb4067fb-80f1-429e-b7e6-d188f299ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:23.606062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4067fb-80f1-429e-b7e6-d188f299ad22 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:23.610003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc4184-9379-4b24-8b83-59d7395aa4ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:23.610660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc4184-9379-4b24-8b83-59d7395aa4ce service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:23.610968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc4184-9379-4b24-8b83-59d7395aa4ce service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:23.611275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc4184-9379-4b24-8b83-59d7395aa4ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:23.684650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc4184-9379-4b24-8b83-59d7395aa4ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:23.686125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc4184-9379-4b24-8b83-59d7395aa4ce service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:23.696566 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1215/2453] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:24.942948 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e31339-366a-45bc-a017-c236dc1cb17a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:24.944015 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e31339-366a-45bc-a017-c236dc1cb17a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:24.944517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e31339-366a-45bc-a017-c236dc1cb17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:24.969187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-09e31339-366a-45bc-a017-c236dc1cb17a None None] MFA Rules not processed for user `58fb392b863c48cb9c6ae5c209e9cac3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:24.970416 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-09e31339-366a-45bc-a017-c236dc1cb17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:25.033748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1239/2454] 10.222.0.93 () {58 vars in 967 bytes} [Thu May 26 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:25.046228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc4184-9379-4b24-8b83-59d7395aa4ce service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:25.048414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2cbc4184-9379-4b24-8b83-59d7395aa4ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:25.120552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=100 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:25.150069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc4184-9379-4b24-8b83-59d7395aa4ce service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:25.155740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14586e-fb5d-4c5c-b5b8-36852d491106 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cfc967b8634e60b3ddfe4168a748b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:25.156438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14586e-fb5d-4c5c-b5b8-36852d491106 service swift] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:25.156719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14586e-fb5d-4c5c-b5b8-36852d491106 service swift] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:25.157005 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14586e-fb5d-4c5c-b5b8-36852d491106 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:25.166634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14586e-fb5d-4c5c-b5b8-36852d491106 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:25.168261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14586e-fb5d-4c5c-b5b8-36852d491106 service swift] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:25.177828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1216/2455] 10.222.0.93 () {60 vars in 1384 bytes} [Thu May 26 17:11:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:11:25.755502 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e31339-366a-45bc-a017-c236dc1cb17a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:25.765251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e31339-366a-45bc-a017-c236dc1cb17a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:25.769131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054287b1-7569-4cb3-8841-70928e545a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:25.769793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054287b1-7569-4cb3-8841-70928e545a6f service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:25.770074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054287b1-7569-4cb3-8841-70928e545a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:25.770399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054287b1-7569-4cb3-8841-70928e545a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:25.782034 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054287b1-7569-4cb3-8841-70928e545a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:25.783612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054287b1-7569-4cb3-8841-70928e545a6f service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:25.788678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:25.795335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1240/2456] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:30.943837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14586e-fb5d-4c5c-b5b8-36852d491106 service swift] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:31.008553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14586e-fb5d-4c5c-b5b8-36852d491106 service swift] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:31.014026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:31.014958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:31.015240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:31.015518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] PATH_INFO: `/v3/users/06e47f406abb456aa69613c80f20172d` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:31.017041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e47f406abb456aa69613c80f20172d)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:31.019040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:31.198989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e47f406abb456aa69613c80f20172d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:31.206182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e47f406abb456aa69613c80f20172d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:31.206870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e47f406abb456aa69613c80f20172d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:31.220622 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e47f406abb456aa69613c80f20172d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:31.221334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e47f406abb456aa69613c80f20172d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:31.327398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1217/2457] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:30 2022] DELETE /identity/v3/users/06e47f406abb456aa69613c80f20172d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:31.331962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76eeb1a-a36e-4dbd-8233-3331216d3b79 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:31.332488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76eeb1a-a36e-4dbd-8233-3331216d3b79 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:31.332488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76eeb1a-a36e-4dbd-8233-3331216d3b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:31.351114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b76eeb1a-a36e-4dbd-8233-3331216d3b79 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:31.352343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b76eeb1a-a36e-4dbd-8233-3331216d3b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:31.412811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1241/2458] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:31.423100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:31.424586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:31.484463 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73df0fe-43e5-4204-ac98-d1b9a43389e6 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:31.488240 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cd5c4-31c5-40db-bde7-05f4c30845c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:31.489504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cd5c4-31c5-40db-bde7-05f4c30845c9 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:31.489795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cd5c4-31c5-40db-bde7-05f4c30845c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:31.490069 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cd5c4-31c5-40db-bde7-05f4c30845c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:31.499440 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cd5c4-31c5-40db-bde7-05f4c30845c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:31.501025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cd5c4-31c5-40db-bde7-05f4c30845c9 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:31.511227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1218/2459] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:32.016592 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76eeb1a-a36e-4dbd-8233-3331216d3b79 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:32.031816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b76eeb1a-a36e-4dbd-8233-3331216d3b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:32.031816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76eeb1a-a36e-4dbd-8233-3331216d3b79 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:32.039314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:32.040207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:32.040487 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:32.040797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] PATH_INFO: `/v3/projects/2880c24f33e54c0395e029257f566ff7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:32.041994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2880c24f33e54c0395e029257f566ff7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:32.052732 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:32.250791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2880c24f33e54c0395e029257f566ff7', 'request_id': 'req-bc4d1a99-68b5-4e4d-9258-4887671a33b9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.258110 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2880c24f33e54c0395e029257f566ff7', 'request_id': 'req-bc4d1a99-68b5-4e4d-9258-4887671a33b9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.263868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2880c24f33e54c0395e029257f566ff7', 'request_id': 'req-bc4d1a99-68b5-4e4d-9258-4887671a33b9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.379888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] The token cache is being invalidate because project 2880c24f33e54c0395e029257f566ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:32.381082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.381372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.383114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1242/2460] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:32 2022] DELETE /identity/v3/projects/2880c24f33e54c0395e029257f566ff7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:32.387649 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cd5c4-31c5-40db-bde7-05f4c30845c9 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:32.398319 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cd5c4-31c5-40db-bde7-05f4c30845c9 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:32.403499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:32.461284 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:32.462156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:32.462438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:32.462714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] PATH_INFO: `/v3/users/8e9ce58498d24c1c9d97f8eb54dc4842` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:32.463955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9ce58498d24c1c9d97f8eb54dc4842)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:32.465943 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:32.678220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9ce58498d24c1c9d97f8eb54dc4842'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.685383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9ce58498d24c1c9d97f8eb54dc4842'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.686114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9ce58498d24c1c9d97f8eb54dc4842'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.700393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9ce58498d24c1c9d97f8eb54dc4842'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.701283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9ce58498d24c1c9d97f8eb54dc4842'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:32.791486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1219/2461] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:32 2022] DELETE /identity/v3/users/8e9ce58498d24c1c9d97f8eb54dc4842 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:33.521178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:33.525697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:33.546957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d1a99-68b5-4e4d-9258-4887671a33b9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:33.625821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:33.626523 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:33.626802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:33.627076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] PATH_INFO: `/v3/projects/582fc07526e94c398fa05ce7d1b4eca4` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:33.628323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] RBAC: Authorizing `identity:delete_project(project_id=582fc07526e94c398fa05ce7d1b4eca4)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:33.631332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:33.670999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:33.803700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582fc07526e94c398fa05ce7d1b4eca4', 'request_id': 'req-5a62ca05-0b45-4a51-97b3-273851e7deca'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:33.809946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582fc07526e94c398fa05ce7d1b4eca4', 'request_id': 'req-5a62ca05-0b45-4a51-97b3-273851e7deca'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:33.823506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582fc07526e94c398fa05ce7d1b4eca4', 'request_id': 'req-5a62ca05-0b45-4a51-97b3-273851e7deca'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:34.004192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] The token cache is being invalidate because project 582fc07526e94c398fa05ce7d1b4eca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:34.004632 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:34.005285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:34.007311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1243/2462] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:33 2022] DELETE /identity/v3/projects/582fc07526e94c398fa05ce7d1b4eca4 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:34.011079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:34.012919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:34.026852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134d644-68af-436c-ac9a-8d8e5eff227c admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:34.092578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:34.093379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:34.093668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:34.093949 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] PATH_INFO: `/v3/users/03587c34416b408b87beb39ed5130344` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:34.095171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03587c34416b408b87beb39ed5130344)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:34.097234 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:34.410619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:34.424946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03587c34416b408b87beb39ed5130344'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:34.432001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03587c34416b408b87beb39ed5130344'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:34.432682 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03587c34416b408b87beb39ed5130344'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:34.444625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03587c34416b408b87beb39ed5130344'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:34.445326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03587c34416b408b87beb39ed5130344'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:34.587408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1220/2463] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:34 2022] DELETE /identity/v3/users/03587c34416b408b87beb39ed5130344 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:35.046114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:35.047581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:35.064682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ca05-0b45-4a51-97b3-273851e7deca admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:35.134777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:35.139916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:35.140392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:35.142210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] PATH_INFO: `/v3/projects/457aa6b4804541f3a0919ee80d01abdf` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:35.142210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457aa6b4804541f3a0919ee80d01abdf)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:35.144128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:35.175690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:35.177123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:35.237092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac441a-e9ca-42b0-a5c5-80e0963c5b77 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:35.241125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d102be-68d9-42f9-b4d5-bae8518e6a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:35.241772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d102be-68d9-42f9-b4d5-bae8518e6a6b service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:35.242056 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d102be-68d9-42f9-b4d5-bae8518e6a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:35.242359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d102be-68d9-42f9-b4d5-bae8518e6a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:35.244169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-95d102be-68d9-42f9-b4d5-bae8518e6a6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:35.256550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d102be-68d9-42f9-b4d5-bae8518e6a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:35.258062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d102be-68d9-42f9-b4d5-bae8518e6a6b service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:35.268161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1221/2464] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:11:35.294863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457aa6b4804541f3a0919ee80d01abdf', 'request_id': 'req-55c6ff35-b442-4905-82c4-241eb54eca57'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:35.301697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457aa6b4804541f3a0919ee80d01abdf', 'request_id': 'req-55c6ff35-b442-4905-82c4-241eb54eca57'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:35.309061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457aa6b4804541f3a0919ee80d01abdf', 'request_id': 'req-55c6ff35-b442-4905-82c4-241eb54eca57'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:35.427250 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] The token cache is being invalidate because project 457aa6b4804541f3a0919ee80d01abdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:35.427822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:35.428746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-55c6ff35-b442-4905-82c4-241eb54eca57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:35.434907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1244/2465] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:35 2022] DELETE /identity/v3/projects/457aa6b4804541f3a0919ee80d01abdf => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:35.439071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c18e9-896c-4260-ad07-7b2c7d57118a None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:35.443619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c18e9-896c-4260-ad07-7b2c7d57118a None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:35.443619 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c18e9-896c-4260-ad07-7b2c7d57118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:35.460053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-511c18e9-896c-4260-ad07-7b2c7d57118a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:35.461275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-511c18e9-896c-4260-ad07-7b2c7d57118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:35.534494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1222/2466] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:35.542286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af6646-cc91-4c1c-af96-1c206ef0ca76 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:35.542574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af6646-cc91-4c1c-af96-1c206ef0ca76 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:35.542856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af6646-cc91-4c1c-af96-1c206ef0ca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:35.561777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-03af6646-cc91-4c1c-af96-1c206ef0ca76 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:35.563930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-03af6646-cc91-4c1c-af96-1c206ef0ca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:35.572281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1245/2467] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:35.576676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c18e9-896c-4260-ad07-7b2c7d57118a None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:35.587332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c18e9-896c-4260-ad07-7b2c7d57118a None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:35.592368 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2d8d-21d4-418a-83db-b631af131556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:35.598337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2d8d-21d4-418a-83db-b631af131556 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:35.598337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2d8d-21d4-418a-83db-b631af131556 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:35.598337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2d8d-21d4-418a-83db-b631af131556 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:35.598337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e2d8d-21d4-418a-83db-b631af131556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:35.598337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e2d8d-21d4-418a-83db-b631af131556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:35.598337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e2d8d-21d4-418a-83db-b631af131556 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:35.608640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1223/2468] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:11:35.613257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af6646-cc91-4c1c-af96-1c206ef0ca76 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:35.623667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af6646-cc91-4c1c-af96-1c206ef0ca76 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:35.628414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184834a6-c1a7-48d6-9b3a-35333b24d514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:35.635599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184834a6-c1a7-48d6-9b3a-35333b24d514 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:35.635599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184834a6-c1a7-48d6-9b3a-35333b24d514 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:35.635599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184834a6-c1a7-48d6-9b3a-35333b24d514 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:35.635599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184834a6-c1a7-48d6-9b3a-35333b24d514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:35.635599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184834a6-c1a7-48d6-9b3a-35333b24d514 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:35.741821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1246/2469] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:35 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:35.742505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2d8d-21d4-418a-83db-b631af131556 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:35.753136 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2d8d-21d4-418a-83db-b631af131556 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:35.797873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:35.826309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5f94-d8a2-4405-a505-0545879abf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:35.826990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5f94-d8a2-4405-a505-0545879abf09 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:35.827275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5f94-d8a2-4405-a505-0545879abf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:35.827551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5f94-d8a2-4405-a505-0545879abf09 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:35.828327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e5f94-d8a2-4405-a505-0545879abf09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:35.831191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e5f94-d8a2-4405-a505-0545879abf09 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:35.942847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184834a6-c1a7-48d6-9b3a-35333b24d514 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:35.944465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1224/2470] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:35 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:35.957950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184834a6-c1a7-48d6-9b3a-35333b24d514 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:35.963211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f4a83-d43d-4d4f-ac42-17b00a2014c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:35.966889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f4a83-d43d-4d4f-ac42-17b00a2014c4 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:35.966889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f4a83-d43d-4d4f-ac42-17b00a2014c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:35.966889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f4a83-d43d-4d4f-ac42-17b00a2014c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:35.966889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f4a83-d43d-4d4f-ac42-17b00a2014c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:35.968239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f4a83-d43d-4d4f-ac42-17b00a2014c4 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:35.980016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1247/2471] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:35.983587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5f94-d8a2-4405-a505-0545879abf09 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:35.994557 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5f94-d8a2-4405-a505-0545879abf09 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:35.999709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e625a-2ed4-4673-9a03-d1b87f761918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:36.000111 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e625a-2ed4-4673-9a03-d1b87f761918 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:36.000397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e625a-2ed4-4673-9a03-d1b87f761918 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:36.000673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e625a-2ed4-4673-9a03-d1b87f761918 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:36.001410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e625a-2ed4-4673-9a03-d1b87f761918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:36.003027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e625a-2ed4-4673-9a03-d1b87f761918 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:36.017564 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1225/2472] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:11:36.019268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f4a83-d43d-4d4f-ac42-17b00a2014c4 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:36.030680 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:36.030800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f4a83-d43d-4d4f-ac42-17b00a2014c4 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:36.037225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673944f0-0fe7-4168-a860-cc0483064f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:36.038127 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673944f0-0fe7-4168-a860-cc0483064f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:36.038406 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673944f0-0fe7-4168-a860-cc0483064f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:36.038682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673944f0-0fe7-4168-a860-cc0483064f4d admin admin] PATH_INFO: `/v3/projects/9c48ff79ee7e41c484be81bc6962263c/users/d25bb94ca01b4989a1121a414b9ae03e/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:36.060759 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673944f0-0fe7-4168-a860-cc0483064f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c48ff79ee7e41c484be81bc6962263c, user_id=d25bb94ca01b4989a1121a414b9ae03e, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:36.063912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673944f0-0fe7-4168-a860-cc0483064f4d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:36.159135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1248/2473] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:36 2022] PUT /identity/v3/projects/9c48ff79ee7e41c484be81bc6962263c/users/d25bb94ca01b4989a1121a414b9ae03e/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:36.171250 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32036bc-e592-4742-9705-d17c304bd631 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:36.171534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32036bc-e592-4742-9705-d17c304bd631 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:36.171841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32036bc-e592-4742-9705-d17c304bd631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:36.206625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e32036bc-e592-4742-9705-d17c304bd631 None None] MFA Rules not processed for user `d25bb94ca01b4989a1121a414b9ae03e`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:36.207891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e32036bc-e592-4742-9705-d17c304bd631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:36.283269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1226/2474] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:36.295555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673944f0-0fe7-4168-a860-cc0483064f4d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:36.297315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-673944f0-0fe7-4168-a860-cc0483064f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:36.356479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673944f0-0fe7-4168-a860-cc0483064f4d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:36.361394 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7b8d9-12ca-4b1b-abf2-e199b50948f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4145a3bf87a94f4e9d39e16dc483595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:36.361606 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7b8d9-12ca-4b1b-abf2-e199b50948f7 service glance] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:36.361828 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7b8d9-12ca-4b1b-abf2-e199b50948f7 service glance] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:36.362102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7b8d9-12ca-4b1b-abf2-e199b50948f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:36.372876 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7b8d9-12ca-4b1b-abf2-e199b50948f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:36.374556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7b8d9-12ca-4b1b-abf2-e199b50948f7 service glance] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:36.387211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1249/2475] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:39.237580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32036bc-e592-4742-9705-d17c304bd631 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:39.240754 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e32036bc-e592-4742-9705-d17c304bd631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:39.329499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32036bc-e592-4742-9705-d17c304bd631 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:39.336041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120179f1-a665-4987-b7be-a2e4a1fa1526 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:39.336706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120179f1-a665-4987-b7be-a2e4a1fa1526 service placement] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:39.336982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120179f1-a665-4987-b7be-a2e4a1fa1526 service placement] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:39.337255 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120179f1-a665-4987-b7be-a2e4a1fa1526 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:39.340280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-120179f1-a665-4987-b7be-a2e4a1fa1526 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:39.352179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120179f1-a665-4987-b7be-a2e4a1fa1526 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:39.353783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120179f1-a665-4987-b7be-a2e4a1fa1526 service placement] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:39.369656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1227/2476] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:39.422206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7b8d9-12ca-4b1b-abf2-e199b50948f7 service glance] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:39.423826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-03c7b8d9-12ca-4b1b-abf2-e199b50948f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:39.532188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7b8d9-12ca-4b1b-abf2-e199b50948f7 service glance] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:39.537066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:39.537984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:39.538271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:39.538577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] PATH_INFO: `/v3/users/62b8c8b994e54023933a4ff2ecf68f42` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:39.539819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b8c8b994e54023933a4ff2ecf68f42)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:39.541761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:39.816974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b8c8b994e54023933a4ff2ecf68f42'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:39.906561 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b8c8b994e54023933a4ff2ecf68f42'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:39.914239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b8c8b994e54023933a4ff2ecf68f42'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:39.927530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b8c8b994e54023933a4ff2ecf68f42'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:39.928572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a17c45f7-6723-43c2-a1e7-62f6e3e35672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b8c8b994e54023933a4ff2ecf68f42'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:39.931153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:39.936204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1250/2477] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:39 2022] DELETE /identity/v3/users/62b8c8b994e54023933a4ff2ecf68f42 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:40.262269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120179f1-a665-4987-b7be-a2e4a1fa1526 service placement] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:40.278502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120179f1-a665-4987-b7be-a2e4a1fa1526 service placement] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:40.316580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:40.342603 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:40.343454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.343780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.344061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] PATH_INFO: `/v3/projects/f50bad5c98ca414c854f3358e2f2e0ec` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.345346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50bad5c98ca414c854f3358e2f2e0ec)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:40.347292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:40.473925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50bad5c98ca414c854f3358e2f2e0ec', 'request_id': 'req-734408c6-7dc4-41ee-a73d-d86239147658'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:40.481499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50bad5c98ca414c854f3358e2f2e0ec', 'request_id': 'req-734408c6-7dc4-41ee-a73d-d86239147658'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:40.489974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50bad5c98ca414c854f3358e2f2e0ec', 'request_id': 'req-734408c6-7dc4-41ee-a73d-d86239147658'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:40.586357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] The token cache is being invalidate because project f50bad5c98ca414c854f3358e2f2e0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:40.588964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:40.588964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-734408c6-7dc4-41ee-a73d-d86239147658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:40.588964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1228/2478] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:40 2022] DELETE /identity/v3/projects/f50bad5c98ca414c854f3358e2f2e0ec => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:40.594345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b932e51-e7b8-4d38-a9c9-8ebf14b6765a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.594846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b932e51-e7b8-4d38-a9c9-8ebf14b6765a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.594846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b932e51-e7b8-4d38-a9c9-8ebf14b6765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.614124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3b932e51-e7b8-4d38-a9c9-8ebf14b6765a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:40.615408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3b932e51-e7b8-4d38-a9c9-8ebf14b6765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:40.682136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1251/2479] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:11:40.690606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf010cd-ef14-4435-87ee-374b1604ad14 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.690903 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf010cd-ef14-4435-87ee-374b1604ad14 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.691185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf010cd-ef14-4435-87ee-374b1604ad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.711873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3bf010cd-ef14-4435-87ee-374b1604ad14 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:40.713138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3bf010cd-ef14-4435-87ee-374b1604ad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:40.721728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1229/2480] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:40.726027 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b932e51-e7b8-4d38-a9c9-8ebf14b6765a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:40.736067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b932e51-e7b8-4d38-a9c9-8ebf14b6765a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:40.740713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c76a02-5983-4db7-8eee-3b50897f05dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:40.743753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c76a02-5983-4db7-8eee-3b50897f05dc admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.743753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c76a02-5983-4db7-8eee-3b50897f05dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.743753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c76a02-5983-4db7-8eee-3b50897f05dc admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.743753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c76a02-5983-4db7-8eee-3b50897f05dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:40.743753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c76a02-5983-4db7-8eee-3b50897f05dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:40.744551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c76a02-5983-4db7-8eee-3b50897f05dc admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:40.756692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1252/2481] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:11:40.761177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf010cd-ef14-4435-87ee-374b1604ad14 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:40.770825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf010cd-ef14-4435-87ee-374b1604ad14 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:40.776201 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cca6d-b83d-4858-9813-b9b018afcccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:40.776858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cca6d-b83d-4858-9813-b9b018afcccc admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.777141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cca6d-b83d-4858-9813-b9b018afcccc admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.777416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cca6d-b83d-4858-9813-b9b018afcccc admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.778107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cca6d-b83d-4858-9813-b9b018afcccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:40.780054 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cca6d-b83d-4858-9813-b9b018afcccc admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:40.908845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1230/2482] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:40 2022] POST /identity/v3/projects => generated 401 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:40.913010 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c76a02-5983-4db7-8eee-3b50897f05dc admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:40.923799 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c76a02-5983-4db7-8eee-3b50897f05dc admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:40.984017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddc49a-e1e5-4692-aaed-8c11f29d84bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:40.984715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddc49a-e1e5-4692-aaed-8c11f29d84bd admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:40.984990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddc49a-e1e5-4692-aaed-8c11f29d84bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:40.985265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddc49a-e1e5-4692-aaed-8c11f29d84bd admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:40.985964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddc49a-e1e5-4692-aaed-8c11f29d84bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:40.987953 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddc49a-e1e5-4692-aaed-8c11f29d84bd admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:41.119341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1253/2483] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:40 2022] POST /identity/v3/users => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:41.123497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cca6d-b83d-4858-9813-b9b018afcccc admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:41.133923 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cca6d-b83d-4858-9813-b9b018afcccc admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:41.140299 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27478fc2-5737-43ab-bab3-18cbacdfe0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:41.140988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27478fc2-5737-43ab-bab3-18cbacdfe0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:41.141270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27478fc2-5737-43ab-bab3-18cbacdfe0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:41.141548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27478fc2-5737-43ab-bab3-18cbacdfe0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:41.142277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27478fc2-5737-43ab-bab3-18cbacdfe0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:41.143931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27478fc2-5737-43ab-bab3-18cbacdfe0a2 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:41.155337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1231/2484] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:41.161028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddc49a-e1e5-4692-aaed-8c11f29d84bd admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:41.177484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddc49a-e1e5-4692-aaed-8c11f29d84bd admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:41.178228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827fdfb-7dc1-4c67-8d15-148555983fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:41.178906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827fdfb-7dc1-4c67-8d15-148555983fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:41.179186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827fdfb-7dc1-4c67-8d15-148555983fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:41.179457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827fdfb-7dc1-4c67-8d15-148555983fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:41.180220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827fdfb-7dc1-4c67-8d15-148555983fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:41.181860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827fdfb-7dc1-4c67-8d15-148555983fc5 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:41.193041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1254/2485] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:41.200296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27478fc2-5737-43ab-bab3-18cbacdfe0a2 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:41.215297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27478fc2-5737-43ab-bab3-18cbacdfe0a2 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:41.222384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9d644-ff13-4e28-ad98-76db1f798792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:41.223325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9d644-ff13-4e28-ad98-76db1f798792 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:41.223691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9d644-ff13-4e28-ad98-76db1f798792 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:41.223958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9d644-ff13-4e28-ad98-76db1f798792 admin admin] PATH_INFO: `/v3/projects/3f58297053cc446f9be7a68ceaa30368/users/b6a96734d8864a03a45c90b18e4a512a/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:41.243100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9d644-ff13-4e28-ad98-76db1f798792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f58297053cc446f9be7a68ceaa30368, user_id=b6a96734d8864a03a45c90b18e4a512a, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:41.245807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9d644-ff13-4e28-ad98-76db1f798792 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:41.313080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1232/2486] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:41 2022] PUT /identity/v3/projects/3f58297053cc446f9be7a68ceaa30368/users/b6a96734d8864a03a45c90b18e4a512a/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:41.318202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2786dc-8c7b-482a-8890-ce285019cde9 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:41.318532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2786dc-8c7b-482a-8890-ce285019cde9 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:41.318825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2786dc-8c7b-482a-8890-ce285019cde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:41.337951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-4a2786dc-8c7b-482a-8890-ce285019cde9 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:41.339162 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4a2786dc-8c7b-482a-8890-ce285019cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:41.401389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1255/2487] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:41.411270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9d644-ff13-4e28-ad98-76db1f798792 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:41.413014 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-46d9d644-ff13-4e28-ad98-76db1f798792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:41.471652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9d644-ff13-4e28-ad98-76db1f798792 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:41.475371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44f4c5-f784-4a63-862b-483996c2023c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:41.476052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44f4c5-f784-4a63-862b-483996c2023c service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:41.476339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44f4c5-f784-4a63-862b-483996c2023c service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:41.476617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44f4c5-f784-4a63-862b-483996c2023c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:41.486399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44f4c5-f784-4a63-862b-483996c2023c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:41.487942 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44f4c5-f784-4a63-862b-483996c2023c service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:41.498285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1233/2488] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:43.164787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4c701-b69d-4967-b932-a3c2b1a4b83c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.165337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4c701-b69d-4967-b932-a3c2b1a4b83c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.165337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4c701-b69d-4967-b932-a3c2b1a4b83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.181462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:43.202981 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-15d4c701-b69d-4967-b932-a3c2b1a4b83c None None] MFA Rules not processed for user `b6a96734d8864a03a45c90b18e4a512a`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:43.204445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-15d4c701-b69d-4967-b932-a3c2b1a4b83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:43.281758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1256/2489] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:43.281964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44f4c5-f784-4a63-862b-483996c2023c service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.285061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:43.289511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44f4c5-f784-4a63-862b-483996c2023c service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.294141 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a19c1-e649-4836-8650-517700cc90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.294867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a19c1-e649-4836-8650-517700cc90a4 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.295153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a19c1-e649-4836-8650-517700cc90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.295433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a19c1-e649-4836-8650-517700cc90a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.296280 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a19c1-e649-4836-8650-517700cc90a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.298230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a19c1-e649-4836-8650-517700cc90a4 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.456921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1234/2490] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:43 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:43.461536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4c701-b69d-4967-b932-a3c2b1a4b83c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.472545 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4c701-b69d-4967-b932-a3c2b1a4b83c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.530776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15e1c-5744-426a-b67b-c91af1ff6a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.531583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15e1c-5744-426a-b67b-c91af1ff6a2b admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.531940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15e1c-5744-426a-b67b-c91af1ff6a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.532161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15e1c-5744-426a-b67b-c91af1ff6a2b admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.532879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb15e1c-5744-426a-b67b-c91af1ff6a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.534969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb15e1c-5744-426a-b67b-c91af1ff6a2b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.657427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1257/2491] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:43 2022] POST /identity/v3/users => generated 309 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:11:43.658645 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a19c1-e649-4836-8650-517700cc90a4 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.679536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a19c1-e649-4836-8650-517700cc90a4 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.684890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c49d1c-1e57-4810-8596-b209f009adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.685934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c49d1c-1e57-4810-8596-b209f009adee admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.685934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c49d1c-1e57-4810-8596-b209f009adee admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.686162 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c49d1c-1e57-4810-8596-b209f009adee admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.686898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c49d1c-1e57-4810-8596-b209f009adee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.693184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c49d1c-1e57-4810-8596-b209f009adee admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.700599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1235/2492] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:43.705648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15e1c-5744-426a-b67b-c91af1ff6a2b admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.715907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15e1c-5744-426a-b67b-c91af1ff6a2b admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.721122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a3d0f-e6a3-4311-b5da-5467cf6412b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.722089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a3d0f-e6a3-4311-b5da-5467cf6412b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.722276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a3d0f-e6a3-4311-b5da-5467cf6412b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.722551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a3d0f-e6a3-4311-b5da-5467cf6412b1 admin admin] PATH_INFO: `/v3/projects/2ccfaa19e23e4597a124fdb6677b836a/users/aef3e699ff5845e4acc41247e13bba28/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.738362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a3d0f-e6a3-4311-b5da-5467cf6412b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccfaa19e23e4597a124fdb6677b836a, user_id=aef3e699ff5845e4acc41247e13bba28, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.742069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a3d0f-e6a3-4311-b5da-5467cf6412b1 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.850943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1258/2493] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:43 2022] PUT /identity/v3/projects/2ccfaa19e23e4597a124fdb6677b836a/users/aef3e699ff5845e4acc41247e13bba28/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:43.854952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c49d1c-1e57-4810-8596-b209f009adee admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.865827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c49d1c-1e57-4810-8596-b209f009adee admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.923412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764c9f5-c0b7-48e3-9fb7-da89588b7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.924131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764c9f5-c0b7-48e3-9fb7-da89588b7e40 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.924414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764c9f5-c0b7-48e3-9fb7-da89588b7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.924691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764c9f5-c0b7-48e3-9fb7-da89588b7e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.925414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764c9f5-c0b7-48e3-9fb7-da89588b7e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.927766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764c9f5-c0b7-48e3-9fb7-da89588b7e40 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.937749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1236/2494] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:43.941939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a3d0f-e6a3-4311-b5da-5467cf6412b1 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:43.953367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a3d0f-e6a3-4311-b5da-5467cf6412b1 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:43.957974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ba6e0-9a87-41e5-b5a2-57033e352e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:43.958917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba6e0-9a87-41e5-b5a2-57033e352e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:43.959199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba6e0-9a87-41e5-b5a2-57033e352e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:43.959471 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba6e0-9a87-41e5-b5a2-57033e352e24 admin admin] PATH_INFO: `/v3/projects/2ccfaa19e23e4597a124fdb6677b836a/users/aef3e699ff5845e4acc41247e13bba28/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:43.961500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ba6e0-9a87-41e5-b5a2-57033e352e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccfaa19e23e4597a124fdb6677b836a, user_id=aef3e699ff5845e4acc41247e13bba28, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:43.964191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ba6e0-9a87-41e5-b5a2-57033e352e24 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:43.976405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1259/2495] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:43 2022] PUT /identity/v3/projects/2ccfaa19e23e4597a124fdb6677b836a/users/aef3e699ff5845e4acc41247e13bba28/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:45.651244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a16673-db90-4f3c-b7ee-d918c7ddc565 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:45.651953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a16673-db90-4f3c-b7ee-d918c7ddc565 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:45.651953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a16673-db90-4f3c-b7ee-d918c7ddc565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:45.686124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a9a16673-db90-4f3c-b7ee-d918c7ddc565 None None] MFA Rules not processed for user `aef3e699ff5845e4acc41247e13bba28`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:45.687341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a9a16673-db90-4f3c-b7ee-d918c7ddc565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:45.766488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1237/2496] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:47.110849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ba6e0-9a87-41e5-b5a2-57033e352e24 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.112144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e78ba6e0-9a87-41e5-b5a2-57033e352e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:47.165781 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:47.184824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ba6e0-9a87-41e5-b5a2-57033e352e24 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.190470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1ea61-f042-4721-b9aa-08047068bfd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.194215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1ea61-f042-4721-b9aa-08047068bfd7 service placement] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.194215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1ea61-f042-4721-b9aa-08047068bfd7 service placement] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.194215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1ea61-f042-4721-b9aa-08047068bfd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.194215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5fb1ea61-f042-4721-b9aa-08047068bfd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:47.208888 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1ea61-f042-4721-b9aa-08047068bfd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.210529 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1ea61-f042-4721-b9aa-08047068bfd7 service placement] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.221353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1260/2497] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:47.253881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a16673-db90-4f3c-b7ee-d918c7ddc565 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.310349 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:47.321574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a16673-db90-4f3c-b7ee-d918c7ddc565 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:47.328260 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:47.329262 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:47.329473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:47.329750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] PATH_INFO: `/v3/users/b6a96734d8864a03a45c90b18e4a512a` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:47.331268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a96734d8864a03a45c90b18e4a512a)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:47.333824 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:47.548556 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a96734d8864a03a45c90b18e4a512a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:47.555547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a96734d8864a03a45c90b18e4a512a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:47.556274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a96734d8864a03a45c90b18e4a512a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:47.569483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a96734d8864a03a45c90b18e4a512a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:47.570177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a96734d8864a03a45c90b18e4a512a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:47.666087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1238/2498] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:47 2022] DELETE /identity/v3/users/b6a96734d8864a03a45c90b18e4a512a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:47.939222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1ea61-f042-4721-b9aa-08047068bfd7 service placement] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:47.963522 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1ea61-f042-4721-b9aa-08047068bfd7 service placement] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:48.026641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:48.027774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:48.032418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:48.032418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] PATH_INFO: `/v3/projects/3f58297053cc446f9be7a68ceaa30368` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:48.032418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f58297053cc446f9be7a68ceaa30368)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:48.032418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:48.187681 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f58297053cc446f9be7a68ceaa30368', 'request_id': 'req-37299843-7f18-4de7-b668-9d89f5f95e13'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.194982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f58297053cc446f9be7a68ceaa30368', 'request_id': 'req-37299843-7f18-4de7-b668-9d89f5f95e13'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.200502 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f58297053cc446f9be7a68ceaa30368', 'request_id': 'req-37299843-7f18-4de7-b668-9d89f5f95e13'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.352372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] The token cache is being invalidate because project 3f58297053cc446f9be7a68ceaa30368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:48.352663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.353310 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.354883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1261/2499] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:47 2022] DELETE /identity/v3/projects/3f58297053cc446f9be7a68ceaa30368 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:48.358985 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:48.360440 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:48.373413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be677a-9056-49ed-8df6-665bf7d89b1d admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:48.432746 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:48.433695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:48.434020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:48.434295 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] PATH_INFO: `/v3/users/aef3e699ff5845e4acc41247e13bba28` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:48.435502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef3e699ff5845e4acc41247e13bba28)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:48.437480 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:48.667812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef3e699ff5845e4acc41247e13bba28'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.674868 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef3e699ff5845e4acc41247e13bba28'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.675638 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef3e699ff5845e4acc41247e13bba28'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.688571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef3e699ff5845e4acc41247e13bba28'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.689249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-7d771a58-1d1f-4042-9194-41dbe3a51aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef3e699ff5845e4acc41247e13bba28'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:48.691204 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:48.844717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1239/2500] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:48 2022] DELETE /identity/v3/users/aef3e699ff5845e4acc41247e13bba28 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:49.097484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:49.099525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:49.112976 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37299843-7f18-4de7-b668-9d89f5f95e13 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:49.173560 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:49.174432 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.174714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.174987 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] PATH_INFO: `/v3/projects/2ccfaa19e23e4597a124fdb6677b836a` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.176308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ccfaa19e23e4597a124fdb6677b836a)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:49.179016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:49.190269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:49.330410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ccfaa19e23e4597a124fdb6677b836a', 'request_id': 'req-f520d738-8791-435a-abb5-8e290555d99a'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.337486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ccfaa19e23e4597a124fdb6677b836a', 'request_id': 'req-f520d738-8791-435a-abb5-8e290555d99a'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.343321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ccfaa19e23e4597a124fdb6677b836a', 'request_id': 'req-f520d738-8791-435a-abb5-8e290555d99a'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.446715 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] The token cache is being invalidate because project 2ccfaa19e23e4597a124fdb6677b836a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:49.446945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.447526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f520d738-8791-435a-abb5-8e290555d99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:49.449154 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1262/2501] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:49 2022] DELETE /identity/v3/projects/2ccfaa19e23e4597a124fdb6677b836a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:49.454243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71100e-cc11-45ec-84a3-83d245add722 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.454725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71100e-cc11-45ec-84a3-83d245add722 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.454821 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71100e-cc11-45ec-84a3-83d245add722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.474531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3c71100e-cc11-45ec-84a3-83d245add722 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:49.475820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3c71100e-cc11-45ec-84a3-83d245add722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:49.537786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1240/2502] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:49.545685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd95d7f-373a-4914-bf16-51c31f370d62 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.549490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd95d7f-373a-4914-bf16-51c31f370d62 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.549490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd95d7f-373a-4914-bf16-51c31f370d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.565634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5cd95d7f-373a-4914-bf16-51c31f370d62 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:49.566895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5cd95d7f-373a-4914-bf16-51c31f370d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:49.575212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1263/2503] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:49.586607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71100e-cc11-45ec-84a3-83d245add722 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:49.596967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71100e-cc11-45ec-84a3-83d245add722 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:49.602306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a29cfd-41f2-43aa-b2ef-6943119bda40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:49.602997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a29cfd-41f2-43aa-b2ef-6943119bda40 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.603264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a29cfd-41f2-43aa-b2ef-6943119bda40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.603539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a29cfd-41f2-43aa-b2ef-6943119bda40 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.604304 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a29cfd-41f2-43aa-b2ef-6943119bda40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:11:49.604610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a29cfd-41f2-43aa-b2ef-6943119bda40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:49.606227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a29cfd-41f2-43aa-b2ef-6943119bda40 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:49.619894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1241/2504] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:11:49.625053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd95d7f-373a-4914-bf16-51c31f370d62 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:49.635108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd95d7f-373a-4914-bf16-51c31f370d62 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:49.641816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b54470-d3af-45e2-a4d2-3c849bab8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:49.642322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54470-d3af-45e2-a4d2-3c849bab8c30 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.648603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54470-d3af-45e2-a4d2-3c849bab8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.648603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54470-d3af-45e2-a4d2-3c849bab8c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.648603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b54470-d3af-45e2-a4d2-3c849bab8c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:49.648603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b54470-d3af-45e2-a4d2-3c849bab8c30 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:49.742399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1264/2505] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:49 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:49.746467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a29cfd-41f2-43aa-b2ef-6943119bda40 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:49.756977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a29cfd-41f2-43aa-b2ef-6943119bda40 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:49.813152 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471beef2-2b75-45cc-a29e-cfe7346b523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:49.813815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471beef2-2b75-45cc-a29e-cfe7346b523c admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.814100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471beef2-2b75-45cc-a29e-cfe7346b523c admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.814377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471beef2-2b75-45cc-a29e-cfe7346b523c admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.815067 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471beef2-2b75-45cc-a29e-cfe7346b523c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:49.817010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471beef2-2b75-45cc-a29e-cfe7346b523c admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:49.898598 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1242/2506] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:49 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:49.902683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b54470-d3af-45e2-a4d2-3c849bab8c30 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:49.913457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b54470-d3af-45e2-a4d2-3c849bab8c30 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:49.918276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2350ea-1d8f-46e2-b7bc-b9b4f9bba472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:49.918920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2350ea-1d8f-46e2-b7bc-b9b4f9bba472 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.919201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2350ea-1d8f-46e2-b7bc-b9b4f9bba472 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.919474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2350ea-1d8f-46e2-b7bc-b9b4f9bba472 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.920240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2350ea-1d8f-46e2-b7bc-b9b4f9bba472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:49.921833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2350ea-1d8f-46e2-b7bc-b9b4f9bba472 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:49.933102 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1265/2507] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:49.947528 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471beef2-2b75-45cc-a29e-cfe7346b523c admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:49.957654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471beef2-2b75-45cc-a29e-cfe7346b523c admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:49.962851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29c73f-0898-4eca-bacc-ee33037f4b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:49.963488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c73f-0898-4eca-bacc-ee33037f4b32 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.963799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c73f-0898-4eca-bacc-ee33037f4b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.964074 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c73f-0898-4eca-bacc-ee33037f4b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:49.964818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29c73f-0898-4eca-bacc-ee33037f4b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:49.966407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29c73f-0898-4eca-bacc-ee33037f4b32 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:49.976573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1243/2508] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:49.982237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2350ea-1d8f-46e2-b7bc-b9b4f9bba472 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:49.992944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2350ea-1d8f-46e2-b7bc-b9b4f9bba472 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:49.997707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746cd4-aedd-4596-885a-1ebd4880605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:49.998615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746cd4-aedd-4596-885a-1ebd4880605e admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:49.998843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746cd4-aedd-4596-885a-1ebd4880605e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:49.999120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746cd4-aedd-4596-885a-1ebd4880605e admin admin] PATH_INFO: `/v3/projects/aea9792d4d5a4a08b7f1d70f9293cdaa/users/efa65b8f3b604d36b841e6243909c963/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.015273 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8746cd4-aedd-4596-885a-1ebd4880605e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea9792d4d5a4a08b7f1d70f9293cdaa, user_id=efa65b8f3b604d36b841e6243909c963, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:50.018130 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8746cd4-aedd-4596-885a-1ebd4880605e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:50.090138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1266/2509] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:49 2022] PUT /identity/v3/projects/aea9792d4d5a4a08b7f1d70f9293cdaa/users/efa65b8f3b604d36b841e6243909c963/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:50.100613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf613cb-2769-49ab-afc8-92df082792a0 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.100931 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf613cb-2769-49ab-afc8-92df082792a0 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.101214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf613cb-2769-49ab-afc8-92df082792a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.128580 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-2cf613cb-2769-49ab-afc8-92df082792a0 None None] MFA Rules not processed for user `efa65b8f3b604d36b841e6243909c963`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:50.129785 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-2cf613cb-2769-49ab-afc8-92df082792a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:50.174198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:50.194356 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1244/2510] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:50.198933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746cd4-aedd-4596-885a-1ebd4880605e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:50.262239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746cd4-aedd-4596-885a-1ebd4880605e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:50.266941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97097f-3077-4433-834f-33fae30612df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:50.267629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97097f-3077-4433-834f-33fae30612df admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.267914 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97097f-3077-4433-834f-33fae30612df admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.268188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97097f-3077-4433-834f-33fae30612df admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.268887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97097f-3077-4433-834f-33fae30612df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:50.271397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97097f-3077-4433-834f-33fae30612df admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:50.467616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1267/2511] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:11:50 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:50.471791 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf613cb-2769-49ab-afc8-92df082792a0 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:50.483124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf613cb-2769-49ab-afc8-92df082792a0 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:50.547161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e21c-aca3-42ba-9246-f370d4047bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:50.547790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e21c-aca3-42ba-9246-f370d4047bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.548087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e21c-aca3-42ba-9246-f370d4047bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.548362 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e21c-aca3-42ba-9246-f370d4047bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.549064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7e21c-aca3-42ba-9246-f370d4047bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:50.551061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7e21c-aca3-42ba-9246-f370d4047bd8 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:50.693727 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1245/2512] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:11:50 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:11:50.697626 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97097f-3077-4433-834f-33fae30612df admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:50.708528 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97097f-3077-4433-834f-33fae30612df admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:50.713628 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13912-d06a-4ea1-95f3-612b50a5b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:50.714418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13912-d06a-4ea1-95f3-612b50a5b266 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.714820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13912-d06a-4ea1-95f3-612b50a5b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.715165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13912-d06a-4ea1-95f3-612b50a5b266 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.716146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f13912-d06a-4ea1-95f3-612b50a5b266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:50.718072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f13912-d06a-4ea1-95f3-612b50a5b266 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:50.738692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1268/2513] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:50.742083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e21c-aca3-42ba-9246-f370d4047bd8 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:50.752672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e21c-aca3-42ba-9246-f370d4047bd8 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:50.757835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b7e1-3131-4951-acae-c01aa6497d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:50.758792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b7e1-3131-4951-acae-c01aa6497d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.759149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b7e1-3131-4951-acae-c01aa6497d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.759607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b7e1-3131-4951-acae-c01aa6497d12 admin admin] PATH_INFO: `/v3/projects/a32b61d921b64e5b8b1c3842fa662a1e/users/86ebd98ec198433e86093f07bc81278f/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.775464 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44b7e1-3131-4951-acae-c01aa6497d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32b61d921b64e5b8b1c3842fa662a1e, user_id=86ebd98ec198433e86093f07bc81278f, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:50.778160 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44b7e1-3131-4951-acae-c01aa6497d12 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:50.843881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1246/2514] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:50 2022] PUT /identity/v3/projects/a32b61d921b64e5b8b1c3842fa662a1e/users/86ebd98ec198433e86093f07bc81278f/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:50.847907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13912-d06a-4ea1-95f3-612b50a5b266 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:50.859104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13912-d06a-4ea1-95f3-612b50a5b266 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:50.863944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:50.921235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222a27f-2f4d-4ed9-ac68-18f253675600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:50.921930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a27f-2f4d-4ed9-ac68-18f253675600 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.922216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a27f-2f4d-4ed9-ac68-18f253675600 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.922586 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222a27f-2f4d-4ed9-ac68-18f253675600 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.940650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222a27f-2f4d-4ed9-ac68-18f253675600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:50.940650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222a27f-2f4d-4ed9-ac68-18f253675600 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:50.940650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1269/2515] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:11:50.944316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b7e1-3131-4951-acae-c01aa6497d12 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:50.955146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b7e1-3131-4951-acae-c01aa6497d12 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:50.960459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f797b-6385-4b2b-a627-52766abaa530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:50.961322 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f797b-6385-4b2b-a627-52766abaa530 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.961602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f797b-6385-4b2b-a627-52766abaa530 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.961877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f797b-6385-4b2b-a627-52766abaa530 admin admin] PATH_INFO: `/v3/projects/a32b61d921b64e5b8b1c3842fa662a1e/users/86ebd98ec198433e86093f07bc81278f/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:50.963882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f797b-6385-4b2b-a627-52766abaa530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32b61d921b64e5b8b1c3842fa662a1e, user_id=86ebd98ec198433e86093f07bc81278f, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:50.966547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f797b-6385-4b2b-a627-52766abaa530 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:50.977158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1247/2516] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:11:50 2022] PUT /identity/v3/projects/a32b61d921b64e5b8b1c3842fa662a1e/users/86ebd98ec198433e86093f07bc81278f/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:50.988504 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ac7fd-3856-4064-acca-0503f4e1ce77 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:50.988792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ac7fd-3856-4064-acca-0503f4e1ce77 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:50.989069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ac7fd-3856-4064-acca-0503f4e1ce77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:51.015880 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-bd2ac7fd-3856-4064-acca-0503f4e1ce77 None None] MFA Rules not processed for user `86ebd98ec198433e86093f07bc81278f`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:51.017109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bd2ac7fd-3856-4064-acca-0503f4e1ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:51.089787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1270/2517] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:51.109420 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f797b-6385-4b2b-a627-52766abaa530 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:51.111127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e11f797b-6385-4b2b-a627-52766abaa530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:51.172778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f797b-6385-4b2b-a627-52766abaa530 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:51.176602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1075e9-e077-4361-b600-18e6329f5804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:51.177869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1075e9-e077-4361-b600-18e6329f5804 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:51.178152 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1075e9-e077-4361-b600-18e6329f5804 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:51.178429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1075e9-e077-4361-b600-18e6329f5804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:51.231789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:51.235880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1075e9-e077-4361-b600-18e6329f5804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:51.237486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1075e9-e077-4361-b600-18e6329f5804 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:51.247681 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1248/2518] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:53.023646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ac7fd-3856-4064-acca-0503f4e1ce77 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:53.032978 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ac7fd-3856-4064-acca-0503f4e1ce77 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:53.037338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573dbaa-ec40-45ad-aad9-7d8879c32f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:53.038018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573dbaa-ec40-45ad-aad9-7d8879c32f28 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:53.038298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573dbaa-ec40-45ad-aad9-7d8879c32f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:53.038570 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573dbaa-ec40-45ad-aad9-7d8879c32f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:53.048870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573dbaa-ec40-45ad-aad9-7d8879c32f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:53.050336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573dbaa-ec40-45ad-aad9-7d8879c32f28 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:53.060448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1271/2519] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:57.522894 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1075e9-e077-4361-b600-18e6329f5804 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:57.587293 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1075e9-e077-4361-b600-18e6329f5804 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:57.591902 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:57.593057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:57.593365 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:57.593637 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] PATH_INFO: `/v3/users/efa65b8f3b604d36b841e6243909c963` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:57.594817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa65b8f3b604d36b841e6243909c963)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:57.596880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:57.864836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa65b8f3b604d36b841e6243909c963'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:57.872151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa65b8f3b604d36b841e6243909c963'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:57.872968 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa65b8f3b604d36b841e6243909c963'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:57.884845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa65b8f3b604d36b841e6243909c963'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:57.885593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa65b8f3b604d36b841e6243909c963'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:57.978756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1249/2520] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:57 2022] DELETE /identity/v3/users/efa65b8f3b604d36b841e6243909c963 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:11:57.983474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9215-15a8-4ecc-852c-4da126a0e5e2 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:57.983982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9215-15a8-4ecc-852c-4da126a0e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:57.984081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9215-15a8-4ecc-852c-4da126a0e5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:58.001998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d64e9215-15a8-4ecc-852c-4da126a0e5e2 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:11:58.003197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d64e9215-15a8-4ecc-852c-4da126a0e5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:58.061042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1272/2521] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:11:58.073729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:58.073729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:58.133940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6041-944a-4cb4-a92c-5e8444432c77 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:58.137686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1bb1f-40a7-49cc-bdbe-e512e408017b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:58.138352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1bb1f-40a7-49cc-bdbe-e512e408017b service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:58.138637 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1bb1f-40a7-49cc-bdbe-e512e408017b service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:58.138912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1bb1f-40a7-49cc-bdbe-e512e408017b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:58.148788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1bb1f-40a7-49cc-bdbe-e512e408017b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:58.150266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1bb1f-40a7-49cc-bdbe-e512e408017b service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:58.160083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1250/2522] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:11:58.680421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9215-15a8-4ecc-852c-4da126a0e5e2 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:58.681883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d64e9215-15a8-4ecc-852c-4da126a0e5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:58.700589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9215-15a8-4ecc-852c-4da126a0e5e2 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:58.706537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:58.707402 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:58.707706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:58.707982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] PATH_INFO: `/v3/projects/aea9792d4d5a4a08b7f1d70f9293cdaa` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:58.709776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea9792d4d5a4a08b7f1d70f9293cdaa)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:58.711838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:58.727139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:58.874556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea9792d4d5a4a08b7f1d70f9293cdaa', 'request_id': 'req-c5b51c63-a24c-4384-98d8-c3347c602e03'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:58.881116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea9792d4d5a4a08b7f1d70f9293cdaa', 'request_id': 'req-c5b51c63-a24c-4384-98d8-c3347c602e03'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:58.887008 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea9792d4d5a4a08b7f1d70f9293cdaa', 'request_id': 'req-c5b51c63-a24c-4384-98d8-c3347c602e03'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:59.003136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] The token cache is being invalidate because project aea9792d4d5a4a08b7f1d70f9293cdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:11:59.012593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:59.012593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:59.012593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1273/2523] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:58 2022] DELETE /identity/v3/projects/aea9792d4d5a4a08b7f1d70f9293cdaa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:59.015530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1bb1f-40a7-49cc-bdbe-e512e408017b service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:59.025760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1bb1f-40a7-49cc-bdbe-e512e408017b service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:11:59.037055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:11:59.084268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:11:59.085144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:11:59.085452 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:11:59.085834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] PATH_INFO: `/v3/users/86ebd98ec198433e86093f07bc81278f` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:11:59.087051 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ebd98ec198433e86093f07bc81278f)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:11:59.089076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:11:59.319143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ebd98ec198433e86093f07bc81278f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:59.326202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ebd98ec198433e86093f07bc81278f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:59.326907 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ebd98ec198433e86093f07bc81278f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:59.338484 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ebd98ec198433e86093f07bc81278f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:59.339115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-fa1edc65-2e3b-4aac-8a75-278d52fb4225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ebd98ec198433e86093f07bc81278f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:11:59.456237 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1251/2524] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:11:59 2022] DELETE /identity/v3/users/86ebd98ec198433e86093f07bc81278f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:11:59.950171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:11:59.950349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:11:59.964950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b51c63-a24c-4384-98d8-c3347c602e03 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:00.028281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:00.029141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:00.029423 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:00.029697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] PATH_INFO: `/v3/projects/a32b61d921b64e5b8b1c3842fa662a1e` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:00.031141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32b61d921b64e5b8b1c3842fa662a1e)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:00.033115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:00.195956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32b61d921b64e5b8b1c3842fa662a1e', 'request_id': 'req-59ed1ccd-e063-4b2e-b713-ad131ba7503c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:00.202994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32b61d921b64e5b8b1c3842fa662a1e', 'request_id': 'req-59ed1ccd-e063-4b2e-b713-ad131ba7503c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:00.209216 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32b61d921b64e5b8b1c3842fa662a1e', 'request_id': 'req-59ed1ccd-e063-4b2e-b713-ad131ba7503c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:00.386601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] The token cache is being invalidate because project a32b61d921b64e5b8b1c3842fa662a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:00.386893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:00.387553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-59ed1ccd-e063-4b2e-b713-ad131ba7503c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:00.389190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1274/2525] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:11:59 2022] DELETE /identity/v3/projects/a32b61d921b64e5b8b1c3842fa662a1e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:00.394209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78be83-f4af-4c7c-b9dc-c8d13a55dbfd None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:00.394752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78be83-f4af-4c7c-b9dc-c8d13a55dbfd None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:00.394851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78be83-f4af-4c7c-b9dc-c8d13a55dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:00.414306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-7e78be83-f4af-4c7c-b9dc-c8d13a55dbfd None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:00.415514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7e78be83-f4af-4c7c-b9dc-c8d13a55dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:00.482091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1252/2526] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:00.492810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9ed3-285b-4952-b4c3-7caee8ac89a9 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:00.493936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9ed3-285b-4952-b4c3-7caee8ac89a9 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:00.494226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9ed3-285b-4952-b4c3-7caee8ac89a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:00.513439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-284e9ed3-285b-4952-b4c3-7caee8ac89a9 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:00.514658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-284e9ed3-285b-4952-b4c3-7caee8ac89a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:00.523818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1275/2527] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:00.528526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78be83-f4af-4c7c-b9dc-c8d13a55dbfd None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:00.540197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78be83-f4af-4c7c-b9dc-c8d13a55dbfd None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:00.544932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01d417-ae18-4386-96ef-916ccd3bdb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:00.545642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01d417-ae18-4386-96ef-916ccd3bdb3a admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:00.545921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01d417-ae18-4386-96ef-916ccd3bdb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:00.546333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01d417-ae18-4386-96ef-916ccd3bdb3a admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:00.547070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01d417-ae18-4386-96ef-916ccd3bdb3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:00.547377 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01d417-ae18-4386-96ef-916ccd3bdb3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:00.549058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01d417-ae18-4386-96ef-916ccd3bdb3a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:00.562684 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1253/2528] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:00.567098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9ed3-285b-4952-b4c3-7caee8ac89a9 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:00.577866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9ed3-285b-4952-b4c3-7caee8ac89a9 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:00.582741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e612f4-065a-48ea-8a83-9eda1cf6423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:00.583478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e612f4-065a-48ea-8a83-9eda1cf6423e admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:00.583788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e612f4-065a-48ea-8a83-9eda1cf6423e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:00.584091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e612f4-065a-48ea-8a83-9eda1cf6423e admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:00.584815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e612f4-065a-48ea-8a83-9eda1cf6423e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:00.586796 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e612f4-065a-48ea-8a83-9eda1cf6423e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:00.692492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1276/2529] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:00 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:00.693271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01d417-ae18-4386-96ef-916ccd3bdb3a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:00.704188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01d417-ae18-4386-96ef-916ccd3bdb3a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:00.724494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:00.763930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ca12-d3f2-4c28-b791-cf7dd1ff1586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:00.764599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ca12-d3f2-4c28-b791-cf7dd1ff1586 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:00.764882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ca12-d3f2-4c28-b791-cf7dd1ff1586 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:00.765172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ca12-d3f2-4c28-b791-cf7dd1ff1586 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:00.765879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45ca12-d3f2-4c28-b791-cf7dd1ff1586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:00.767883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45ca12-d3f2-4c28-b791-cf7dd1ff1586 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:00.873459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1254/2530] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:00 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:00.877667 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e612f4-065a-48ea-8a83-9eda1cf6423e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:00.883335 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:00.889909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e612f4-065a-48ea-8a83-9eda1cf6423e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:00.894796 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d948b-87ff-401e-ae98-c1eb7cd8b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:00.895451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d948b-87ff-401e-ae98-c1eb7cd8b73a admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:00.896252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d948b-87ff-401e-ae98-c1eb7cd8b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:00.896572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d948b-87ff-401e-ae98-c1eb7cd8b73a admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:00.897286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d948b-87ff-401e-ae98-c1eb7cd8b73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:00.898869 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d948b-87ff-401e-ae98-c1eb7cd8b73a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:00.909765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1277/2531] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:00.914228 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ca12-d3f2-4c28-b791-cf7dd1ff1586 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:00.924132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ca12-d3f2-4c28-b791-cf7dd1ff1586 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:00.929854 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14867a-59ea-47b7-98ad-f3bf0d281ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:00.930930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14867a-59ea-47b7-98ad-f3bf0d281ddf admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:00.931318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14867a-59ea-47b7-98ad-f3bf0d281ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:00.931622 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14867a-59ea-47b7-98ad-f3bf0d281ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:00.932927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14867a-59ea-47b7-98ad-f3bf0d281ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:00.935214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14867a-59ea-47b7-98ad-f3bf0d281ddf admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:00.946196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1255/2532] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:00.950413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d948b-87ff-401e-ae98-c1eb7cd8b73a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:00.960904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d948b-87ff-401e-ae98-c1eb7cd8b73a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:00.965661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78a02-b71b-4b5f-b93d-2b65b30935c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:00.966539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78a02-b71b-4b5f-b93d-2b65b30935c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:00.966815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78a02-b71b-4b5f-b93d-2b65b30935c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:00.967350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78a02-b71b-4b5f-b93d-2b65b30935c6 admin admin] PATH_INFO: `/v3/projects/510ce2f0e351435f894dc3d8789361f8/users/b7671afad48145039f4b3766940549b3/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:00.986932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f78a02-b71b-4b5f-b93d-2b65b30935c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510ce2f0e351435f894dc3d8789361f8, user_id=b7671afad48145039f4b3766940549b3, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:00.986932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f78a02-b71b-4b5f-b93d-2b65b30935c6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:01.105942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1278/2533] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:00 2022] PUT /identity/v3/projects/510ce2f0e351435f894dc3d8789361f8/users/b7671afad48145039f4b3766940549b3/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:01.116907 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd7a7-bff2-43e3-81ed-8a1da651b45f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:01.117182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd7a7-bff2-43e3-81ed-8a1da651b45f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:01.117485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd7a7-bff2-43e3-81ed-8a1da651b45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:01.147750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5dabd7a7-bff2-43e3-81ed-8a1da651b45f None None] MFA Rules not processed for user `b7671afad48145039f4b3766940549b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:01.149033 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5dabd7a7-bff2-43e3-81ed-8a1da651b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:01.215335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1256/2534] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:01.220225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78a02-b71b-4b5f-b93d-2b65b30935c6 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:01.284862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78a02-b71b-4b5f-b93d-2b65b30935c6 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:01.290564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be548-009e-4d75-bdd4-8e8eb00a6de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:01.290963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be548-009e-4d75-bdd4-8e8eb00a6de4 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:01.291248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be548-009e-4d75-bdd4-8e8eb00a6de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:01.291527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be548-009e-4d75-bdd4-8e8eb00a6de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:01.292440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901be548-009e-4d75-bdd4-8e8eb00a6de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:01.294192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901be548-009e-4d75-bdd4-8e8eb00a6de4 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:01.433537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1279/2535] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:01 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:01.437642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd7a7-bff2-43e3-81ed-8a1da651b45f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:01.450450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd7a7-bff2-43e3-81ed-8a1da651b45f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:01.517656 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7ba60-779c-4480-a3a7-56d90f1bacf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:01.518332 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7ba60-779c-4480-a3a7-56d90f1bacf5 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:01.518618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7ba60-779c-4480-a3a7-56d90f1bacf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:01.518898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7ba60-779c-4480-a3a7-56d90f1bacf5 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:01.519613 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7ba60-779c-4480-a3a7-56d90f1bacf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:01.522115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7ba60-779c-4480-a3a7-56d90f1bacf5 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:01.619640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1257/2536] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:01 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:01.623759 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be548-009e-4d75-bdd4-8e8eb00a6de4 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:01.634714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be548-009e-4d75-bdd4-8e8eb00a6de4 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:01.639986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e54a4-8236-4b89-8437-43f71bc41045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:01.640649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e54a4-8236-4b89-8437-43f71bc41045 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:01.644832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e54a4-8236-4b89-8437-43f71bc41045 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:01.644832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e54a4-8236-4b89-8437-43f71bc41045 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:01.644832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e54a4-8236-4b89-8437-43f71bc41045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:01.644832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e54a4-8236-4b89-8437-43f71bc41045 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:01.654574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1280/2537] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:01.658850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7ba60-779c-4480-a3a7-56d90f1bacf5 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:01.669115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7ba60-779c-4480-a3a7-56d90f1bacf5 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:01.673845 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51672-b2f4-4020-a54d-77e2ba98a096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:01.674728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51672-b2f4-4020-a54d-77e2ba98a096 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:01.675009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51672-b2f4-4020-a54d-77e2ba98a096 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:01.675283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51672-b2f4-4020-a54d-77e2ba98a096 admin admin] PATH_INFO: `/v3/projects/508d1d8fdfbd45a8a1077852d4868241/users/3213ff3a2c5d4f1bac73a763a616b40d/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:01.693635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51672-b2f4-4020-a54d-77e2ba98a096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508d1d8fdfbd45a8a1077852d4868241, user_id=3213ff3a2c5d4f1bac73a763a616b40d, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:01.696424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51672-b2f4-4020-a54d-77e2ba98a096 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:01.699683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:01.804191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1258/2538] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:01 2022] PUT /identity/v3/projects/508d1d8fdfbd45a8a1077852d4868241/users/3213ff3a2c5d4f1bac73a763a616b40d/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:01.808511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e54a4-8236-4b89-8437-43f71bc41045 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:01.820085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e54a4-8236-4b89-8437-43f71bc41045 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:01.883679 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afd700-0ea5-4224-959d-a436a5b1f26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:01.884343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afd700-0ea5-4224-959d-a436a5b1f26a admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:01.884624 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afd700-0ea5-4224-959d-a436a5b1f26a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:01.884896 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afd700-0ea5-4224-959d-a436a5b1f26a admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:01.885652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afd700-0ea5-4224-959d-a436a5b1f26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:01.887265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afd700-0ea5-4224-959d-a436a5b1f26a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:01.901694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1281/2539] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:01.906018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51672-b2f4-4020-a54d-77e2ba98a096 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:01.917453 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51672-b2f4-4020-a54d-77e2ba98a096 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:01.923444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf0a52-bb7d-418f-847d-c7957c489902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:01.924686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0a52-bb7d-418f-847d-c7957c489902 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:01.925028 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0a52-bb7d-418f-847d-c7957c489902 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:01.925400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0a52-bb7d-418f-847d-c7957c489902 admin admin] PATH_INFO: `/v3/projects/508d1d8fdfbd45a8a1077852d4868241/users/3213ff3a2c5d4f1bac73a763a616b40d/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:01.928331 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf0a52-bb7d-418f-847d-c7957c489902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508d1d8fdfbd45a8a1077852d4868241, user_id=3213ff3a2c5d4f1bac73a763a616b40d, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:01.931191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf0a52-bb7d-418f-847d-c7957c489902 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:01.945634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1259/2540] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:01 2022] PUT /identity/v3/projects/508d1d8fdfbd45a8a1077852d4868241/users/3213ff3a2c5d4f1bac73a763a616b40d/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:01.958937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1899c11-ba2d-410f-9e9d-ee3bf41a6f2b None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:01.959585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1899c11-ba2d-410f-9e9d-ee3bf41a6f2b None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:01.959943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1899c11-ba2d-410f-9e9d-ee3bf41a6f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:01.990610 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f1899c11-ba2d-410f-9e9d-ee3bf41a6f2b None None] MFA Rules not processed for user `3213ff3a2c5d4f1bac73a763a616b40d`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:01.991517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f1899c11-ba2d-410f-9e9d-ee3bf41a6f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:02.028666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:02.073308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1282/2541] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:02.084156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf0a52-bb7d-418f-847d-c7957c489902 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:02.086190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bfcf0a52-bb7d-418f-847d-c7957c489902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:02.149815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf0a52-bb7d-418f-847d-c7957c489902 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:02.153501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612ce0f-7e90-43cc-994a-bbbe18c89160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:02.154153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612ce0f-7e90-43cc-994a-bbbe18c89160 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:02.154436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612ce0f-7e90-43cc-994a-bbbe18c89160 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:02.154712 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612ce0f-7e90-43cc-994a-bbbe18c89160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:02.164716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612ce0f-7e90-43cc-994a-bbbe18c89160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:02.166154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612ce0f-7e90-43cc-994a-bbbe18c89160 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:02.176098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1260/2542] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:02.290167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1899c11-ba2d-410f-9e9d-ee3bf41a6f2b None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:02.291646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f1899c11-ba2d-410f-9e9d-ee3bf41a6f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:02.363664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1899c11-ba2d-410f-9e9d-ee3bf41a6f2b None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:02.371747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:02.371747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:02.371747 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:02.374568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] PATH_INFO: `/v3/users/68e5b48c8d804399bc3c3b8d026e09b9` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:02.376122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e5b48c8d804399bc3c3b8d026e09b9)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:02.378013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:02.589778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e5b48c8d804399bc3c3b8d026e09b9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:02.660178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e5b48c8d804399bc3c3b8d026e09b9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:02.668344 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e5b48c8d804399bc3c3b8d026e09b9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:02.682262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e5b48c8d804399bc3c3b8d026e09b9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:02.683041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e5b48c8d804399bc3c3b8d026e09b9'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:02.690654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1283/2543] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:02 2022] DELETE /identity/v3/users/68e5b48c8d804399bc3c3b8d026e09b9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:02.695962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0dc2-7cb6-464b-a0b7-3feeaf0716eb None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:02.696474 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0dc2-7cb6-464b-a0b7-3feeaf0716eb None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:02.696574 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0dc2-7cb6-464b-a0b7-3feeaf0716eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:02.714411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-015c0dc2-7cb6-464b-a0b7-3feeaf0716eb None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:02.715668 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-015c0dc2-7cb6-464b-a0b7-3feeaf0716eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:02.751328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:02.752815 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:02.785382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1261/2544] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:02.795367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0dc2-7cb6-464b-a0b7-3feeaf0716eb None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:02.796767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-015c0dc2-7cb6-464b-a0b7-3feeaf0716eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:02.810254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:02.828602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb946f-d328-4820-ac9d-86c6f27a50e3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:02.834005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:02.834868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:02.835232 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:02.835639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] PATH_INFO: `/v3/users/b7671afad48145039f4b3766940549b3` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:02.836845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7671afad48145039f4b3766940549b3)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:02.838861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:02.858787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0dc2-7cb6-464b-a0b7-3feeaf0716eb None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:02.862301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e91972-6a31-4716-bbcf-9e04cb447aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:02.862936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e91972-6a31-4716-bbcf-9e04cb447aba service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:02.863220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e91972-6a31-4716-bbcf-9e04cb447aba service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:02.863490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e91972-6a31-4716-bbcf-9e04cb447aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:02.873628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e91972-6a31-4716-bbcf-9e04cb447aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:02.875050 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e91972-6a31-4716-bbcf-9e04cb447aba service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:02.884853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1262/2545] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:03.129510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7671afad48145039f4b3766940549b3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.237612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7671afad48145039f4b3766940549b3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.245447 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7671afad48145039f4b3766940549b3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.259259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7671afad48145039f4b3766940549b3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.260637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7671afad48145039f4b3766940549b3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.266719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1284/2546] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:02 2022] DELETE /identity/v3/users/b7671afad48145039f4b3766940549b3 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:03.271742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16cfd0-e73f-4ad3-b336-fbe1fefba414 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:03.272110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16cfd0-e73f-4ad3-b336-fbe1fefba414 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:03.272386 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16cfd0-e73f-4ad3-b336-fbe1fefba414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:03.290814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-dc16cfd0-e73f-4ad3-b336-fbe1fefba414 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:03.292055 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-dc16cfd0-e73f-4ad3-b336-fbe1fefba414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:03.321523 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:03.360576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1263/2547] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:03.370292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:03.371736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:03.430377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55e048-25f1-4685-8d22-9ac80ba94166 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:03.433984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163d538-745a-4c68-91fb-7d4f4cbff844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:03.434640 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163d538-745a-4c68-91fb-7d4f4cbff844 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:03.434947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163d538-745a-4c68-91fb-7d4f4cbff844 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:03.435222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163d538-745a-4c68-91fb-7d4f4cbff844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:03.445068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163d538-745a-4c68-91fb-7d4f4cbff844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:03.446512 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163d538-745a-4c68-91fb-7d4f4cbff844 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:03.453513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16cfd0-e73f-4ad3-b336-fbe1fefba414 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:03.456249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-dc16cfd0-e73f-4ad3-b336-fbe1fefba414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:03.468750 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16cfd0-e73f-4ad3-b336-fbe1fefba414 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:03.479084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1285/2548] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:03.480031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:03.482174 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:03.482470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:03.482760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] PATH_INFO: `/v3/projects/57befe947ad74aa493a76a9c1478b7e0` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:03.484170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57befe947ad74aa493a76a9c1478b7e0)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:03.486127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:03.626428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57befe947ad74aa493a76a9c1478b7e0', 'request_id': 'req-65316d22-4500-48c9-be5c-5af219b39be0'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.634373 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57befe947ad74aa493a76a9c1478b7e0', 'request_id': 'req-65316d22-4500-48c9-be5c-5af219b39be0'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.640604 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57befe947ad74aa493a76a9c1478b7e0', 'request_id': 'req-65316d22-4500-48c9-be5c-5af219b39be0'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.755771 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] The token cache is being invalidate because project 57befe947ad74aa493a76a9c1478b7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:03.756753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.757578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:03.759170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1264/2549] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:03 2022] DELETE /identity/v3/projects/57befe947ad74aa493a76a9c1478b7e0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:03.763291 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163d538-745a-4c68-91fb-7d4f4cbff844 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:03.773819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163d538-745a-4c68-91fb-7d4f4cbff844 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:03.847663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:03.848623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:03.849020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:03.849652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] PATH_INFO: `/v3/users/87e7e674cc544beabf7b635991552aff` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:03.851071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e7e674cc544beabf7b635991552aff)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:03.853178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:03.859124 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:04.124862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e7e674cc544beabf7b635991552aff'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.152724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:04.154726 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:04.195478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316d22-4500-48c9-be5c-5af219b39be0 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:04.195478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:04.196760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:04.196760 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:04.196992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] PATH_INFO: `/v3/projects/510ce2f0e351435f894dc3d8789361f8` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:04.198107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510ce2f0e351435f894dc3d8789361f8)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:04.200166 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:04.300936 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e7e674cc544beabf7b635991552aff'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.311088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e7e674cc544beabf7b635991552aff'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.325854 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e7e674cc544beabf7b635991552aff'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.326900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e7e674cc544beabf7b635991552aff'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.338609 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1286/2550] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:03 2022] DELETE /identity/v3/users/87e7e674cc544beabf7b635991552aff => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:04.530415 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510ce2f0e351435f894dc3d8789361f8', 'request_id': 'req-4e39209e-86f2-4df4-b343-046190e24942'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.542230 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510ce2f0e351435f894dc3d8789361f8', 'request_id': 'req-4e39209e-86f2-4df4-b343-046190e24942'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.550397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510ce2f0e351435f894dc3d8789361f8', 'request_id': 'req-4e39209e-86f2-4df4-b343-046190e24942'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.781418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] The token cache is being invalidate because project 510ce2f0e351435f894dc3d8789361f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:04.782093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.782917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:04.785040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1265/2551] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:04 2022] DELETE /identity/v3/projects/510ce2f0e351435f894dc3d8789361f8 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:04.789989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:04.795217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:04.865809 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2795d-915c-4ff0-9566-220f524fe4e9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:04.934297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:04.935360 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:04.935890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:04.936045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] PATH_INFO: `/v3/users/3213ff3a2c5d4f1bac73a763a616b40d` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:04.937245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3213ff3a2c5d4f1bac73a763a616b40d)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:04.939286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:05.076757 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:05.078321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:05.099887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39209e-86f2-4df4-b343-046190e24942 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:05.114661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:05.115546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:05.115859 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:05.116584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] PATH_INFO: `/v3/projects/5327ec738b4848ec9780cd6b948715a4` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:05.117803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5327ec738b4848ec9780cd6b948715a4)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:05.119803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:05.260584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:05.268701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:05.274121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3213ff3a2c5d4f1bac73a763a616b40d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.283098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5327ec738b4848ec9780cd6b948715a4', 'request_id': 'req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.290087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5327ec738b4848ec9780cd6b948715a4', 'request_id': 'req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.295704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5327ec738b4848ec9780cd6b948715a4', 'request_id': 'req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.432090 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3213ff3a2c5d4f1bac73a763a616b40d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.440448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3213ff3a2c5d4f1bac73a763a616b40d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.453444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3213ff3a2c5d4f1bac73a763a616b40d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.454184 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3213ff3a2c5d4f1bac73a763a616b40d'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.460080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1287/2552] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:04 2022] DELETE /identity/v3/users/3213ff3a2c5d4f1bac73a763a616b40d => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:05.463870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:05.465204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:05.549681 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16fc3-e3d3-47ca-ae1c-be4dba1be766 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:05.555748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:05.556773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:05.557135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:05.557482 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] PATH_INFO: `/v3/users/d25bb94ca01b4989a1121a414b9ae03e` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:05.558926 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25bb94ca01b4989a1121a414b9ae03e)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:05.561142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:05.570274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] The token cache is being invalidate because project 5327ec738b4848ec9780cd6b948715a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:05.570583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.572021 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-2de2c4e5-893e-4b31-a5f2-9677bdcabcd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.574407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1266/2553] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:05 2022] DELETE /identity/v3/projects/5327ec738b4848ec9780cd6b948715a4 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:05.578937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcc6d0-a660-4ad5-bfa5-d4afa8401631 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:05.579695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcc6d0-a660-4ad5-bfa5-d4afa8401631 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:05.579695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcc6d0-a660-4ad5-bfa5-d4afa8401631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:05.606010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c5bcc6d0-a660-4ad5-bfa5-d4afa8401631 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:05.607251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c5bcc6d0-a660-4ad5-bfa5-d4afa8401631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:05.615904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1267/2554] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:05.624618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610744c9-556a-44fd-b3b4-fec784d6e83c None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:05.624909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610744c9-556a-44fd-b3b4-fec784d6e83c None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:05.625183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610744c9-556a-44fd-b3b4-fec784d6e83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:05.646216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-610744c9-556a-44fd-b3b4-fec784d6e83c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:05.647505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-610744c9-556a-44fd-b3b4-fec784d6e83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:05.663133 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1268/2555] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:05.667683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610744c9-556a-44fd-b3b4-fec784d6e83c None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:05.678621 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610744c9-556a-44fd-b3b4-fec784d6e83c None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:05.684008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74d8ac-48e6-4947-9221-5f46787b1912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:05.690865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74d8ac-48e6-4947-9221-5f46787b1912 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:05.690865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74d8ac-48e6-4947-9221-5f46787b1912 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:05.690865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74d8ac-48e6-4947-9221-5f46787b1912 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:05.690865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74d8ac-48e6-4947-9221-5f46787b1912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:05.690865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74d8ac-48e6-4947-9221-5f46787b1912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:05.690865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74d8ac-48e6-4947-9221-5f46787b1912 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:05.702307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1269/2556] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:12:05.708683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74d8ac-48e6-4947-9221-5f46787b1912 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:05.732108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74d8ac-48e6-4947-9221-5f46787b1912 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:05.732108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b567c08-e3ba-47cc-b945-536fe299b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:05.732108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b567c08-e3ba-47cc-b945-536fe299b5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:05.732108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b567c08-e3ba-47cc-b945-536fe299b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:05.732680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b567c08-e3ba-47cc-b945-536fe299b5e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:05.732680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b567c08-e3ba-47cc-b945-536fe299b5e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:05.734345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b567c08-e3ba-47cc-b945-536fe299b5e3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:05.818924 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25bb94ca01b4989a1121a414b9ae03e'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.857429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1270/2557] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:05 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:05.861275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b567c08-e3ba-47cc-b945-536fe299b5e3 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:05.920952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b567c08-e3ba-47cc-b945-536fe299b5e3 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:05.925570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a187dd-c830-45e8-aecf-23d07447de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:05.926229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a187dd-c830-45e8-aecf-23d07447de90 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:05.926513 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a187dd-c830-45e8-aecf-23d07447de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:05.926898 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a187dd-c830-45e8-aecf-23d07447de90 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:05.928248 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a187dd-c830-45e8-aecf-23d07447de90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:05.930187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a187dd-c830-45e8-aecf-23d07447de90 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:05.974964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25bb94ca01b4989a1121a414b9ae03e'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.982686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25bb94ca01b4989a1121a414b9ae03e'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.995074 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25bb94ca01b4989a1121a414b9ae03e'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:05.995752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d4a0ca5b-9938-4a3a-bb16-4c59929f91a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25bb94ca01b4989a1121a414b9ae03e'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:06.001593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1288/2558] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:05 2022] DELETE /identity/v3/users/d25bb94ca01b4989a1121a414b9ae03e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:06.005972 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006bfc3-a2da-458f-8956-8d79fdf5d57d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.006261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006bfc3-a2da-458f-8956-8d79fdf5d57d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.006563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006bfc3-a2da-458f-8956-8d79fdf5d57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.027932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-8006bfc3-a2da-458f-8956-8d79fdf5d57d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:06.027932 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8006bfc3-a2da-458f-8956-8d79fdf5d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:06.091666 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1289/2559] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:06.092782 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006bfc3-a2da-458f-8956-8d79fdf5d57d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.094209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8006bfc3-a2da-458f-8956-8d79fdf5d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:06.101693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1271/2560] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:05 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:06.106398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a187dd-c830-45e8-aecf-23d07447de90 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.106398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-b2a187dd-c830-45e8-aecf-23d07447de90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:06.109039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006bfc3-a2da-458f-8956-8d79fdf5d57d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.115163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.116072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.116352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.116651 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] PATH_INFO: `/v3/projects/508d1d8fdfbd45a8a1077852d4868241` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.117984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=508d1d8fdfbd45a8a1077852d4868241)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.119935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:06.166591 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a187dd-c830-45e8-aecf-23d07447de90 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.214333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc158be-8c1a-40cc-98fc-57d0e0da41ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.214982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc158be-8c1a-40cc-98fc-57d0e0da41ff service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.215267 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc158be-8c1a-40cc-98fc-57d0e0da41ff service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.215597 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc158be-8c1a-40cc-98fc-57d0e0da41ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.226116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc158be-8c1a-40cc-98fc-57d0e0da41ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.227617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc158be-8c1a-40cc-98fc-57d0e0da41ff service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:06.237490 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1272/2561] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:06.238297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc158be-8c1a-40cc-98fc-57d0e0da41ff service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.239636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-bfc158be-8c1a-40cc-98fc-57d0e0da41ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:06.252227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc158be-8c1a-40cc-98fc-57d0e0da41ff service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.256933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5174e6-0908-4405-96fb-ed8aa1d5f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.257593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5174e6-0908-4405-96fb-ed8aa1d5f1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.257948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5174e6-0908-4405-96fb-ed8aa1d5f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.258149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5174e6-0908-4405-96fb-ed8aa1d5f1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.258865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5174e6-0908-4405-96fb-ed8aa1d5f1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.260499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5174e6-0908-4405-96fb-ed8aa1d5f1f6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:06.274206 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1273/2562] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:06.280462 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5174e6-0908-4405-96fb-ed8aa1d5f1f6 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.292123 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5174e6-0908-4405-96fb-ed8aa1d5f1f6 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.302321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508d1d8fdfbd45a8a1077852d4868241', 'request_id': 'req-01d9ba97-629f-4508-b974-298e4ea91183'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:06.309537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508d1d8fdfbd45a8a1077852d4868241', 'request_id': 'req-01d9ba97-629f-4508-b974-298e4ea91183'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:06.316195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508d1d8fdfbd45a8a1077852d4868241', 'request_id': 'req-01d9ba97-629f-4508-b974-298e4ea91183'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:06.353343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7f022-ca7f-45d3-935c-e177125c8ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.354009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f022-ca7f-45d3-935c-e177125c8ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.354293 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f022-ca7f-45d3-935c-e177125c8ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.354571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f022-ca7f-45d3-935c-e177125c8ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.355291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7f022-ca7f-45d3-935c-e177125c8ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.356975 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7f022-ca7f-45d3-935c-e177125c8ed6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:06.366822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1274/2563] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:06.371010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7f022-ca7f-45d3-935c-e177125c8ed6 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.380768 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7f022-ca7f-45d3-935c-e177125c8ed6 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.389467 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57e49e-f31c-4fbe-9921-1bf7546652f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.390385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57e49e-f31c-4fbe-9921-1bf7546652f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.390663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57e49e-f31c-4fbe-9921-1bf7546652f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.390934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57e49e-f31c-4fbe-9921-1bf7546652f3 admin admin] PATH_INFO: `/v3/projects/a83da780cc3c4cae95338b18f09c1fae/users/2d6c7f7314dd46fe9710781c13bbe503/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.398070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:06.406442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57e49e-f31c-4fbe-9921-1bf7546652f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83da780cc3c4cae95338b18f09c1fae, user_id=2d6c7f7314dd46fe9710781c13bbe503, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.409120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57e49e-f31c-4fbe-9921-1bf7546652f3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:06.465726 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] The token cache is being invalidate because project 508d1d8fdfbd45a8a1077852d4868241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:06.466022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:06.466678 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-01d9ba97-629f-4508-b974-298e4ea91183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:06.468536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1290/2564] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:06 2022] DELETE /identity/v3/projects/508d1d8fdfbd45a8a1077852d4868241 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:06.473187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58081b-8e3a-44a1-9c70-371895cf068f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.473488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58081b-8e3a-44a1-9c70-371895cf068f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.474458 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58081b-8e3a-44a1-9c70-371895cf068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.492634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5c58081b-8e3a-44a1-9c70-371895cf068f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:06.493847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5c58081b-8e3a-44a1-9c70-371895cf068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:06.501978 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1291/2565] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:06.510022 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d437c96-4f3b-4de5-bc83-738fb2020e9c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.511397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d437c96-4f3b-4de5-bc83-738fb2020e9c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.511397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d437c96-4f3b-4de5-bc83-738fb2020e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.530083 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5d437c96-4f3b-4de5-bc83-738fb2020e9c None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:06.531730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5d437c96-4f3b-4de5-bc83-738fb2020e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:06.534007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:06.542417 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1275/2566] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:06 2022] PUT /identity/v3/projects/a83da780cc3c4cae95338b18f09c1fae/users/2d6c7f7314dd46fe9710781c13bbe503/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:06.553263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47faaa2-8a5e-4633-b6fc-4442a5d1a1ab None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.553600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47faaa2-8a5e-4633-b6fc-4442a5d1a1ab None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.553816 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47faaa2-8a5e-4633-b6fc-4442a5d1a1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.586687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a47faaa2-8a5e-4633-b6fc-4442a5d1a1ab None None] MFA Rules not processed for user `2d6c7f7314dd46fe9710781c13bbe503`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:06.588495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a47faaa2-8a5e-4633-b6fc-4442a5d1a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:06.604294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1292/2567] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:06.608192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d437c96-4f3b-4de5-bc83-738fb2020e9c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.618721 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d437c96-4f3b-4de5-bc83-738fb2020e9c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.625587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd508343-3e32-4b8d-9918-763773884f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.626366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd508343-3e32-4b8d-9918-763773884f95 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.626719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd508343-3e32-4b8d-9918-763773884f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.626998 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd508343-3e32-4b8d-9918-763773884f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.627787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd508343-3e32-4b8d-9918-763773884f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:06.631899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd508343-3e32-4b8d-9918-763773884f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.631899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd508343-3e32-4b8d-9918-763773884f95 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:06.647269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1293/2568] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:12:06.651108 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd508343-3e32-4b8d-9918-763773884f95 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.660644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd508343-3e32-4b8d-9918-763773884f95 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.668168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f65de-7dfd-4a1a-b9fe-9d522c37a058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.668824 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f65de-7dfd-4a1a-b9fe-9d522c37a058 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.669105 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f65de-7dfd-4a1a-b9fe-9d522c37a058 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.669377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f65de-7dfd-4a1a-b9fe-9d522c37a058 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.670067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f65de-7dfd-4a1a-b9fe-9d522c37a058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.672689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f65de-7dfd-4a1a-b9fe-9d522c37a058 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:06.679876 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1276/2569] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:06.684371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47faaa2-8a5e-4633-b6fc-4442a5d1a1ab None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.690475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a47faaa2-8a5e-4633-b6fc-4442a5d1a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:06.699963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47faaa2-8a5e-4633-b6fc-4442a5d1a1ab None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.704539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370f713-a49a-4c63-a774-676d588ce27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.705182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f713-a49a-4c63-a774-676d588ce27f admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.705465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f713-a49a-4c63-a774-676d588ce27f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.705740 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f713-a49a-4c63-a774-676d588ce27f admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.706428 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370f713-a49a-4c63-a774-676d588ce27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.709025 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370f713-a49a-4c63-a774-676d588ce27f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:06.781245 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1294/2570] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:06 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:06.782223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f65de-7dfd-4a1a-b9fe-9d522c37a058 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.784034 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2f6f65de-7dfd-4a1a-b9fe-9d522c37a058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:06.805494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1277/2571] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:06 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:06.805494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370f713-a49a-4c63-a774-676d588ce27f admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:06.867075 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f65de-7dfd-4a1a-b9fe-9d522c37a058 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.876294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.877257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.878142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.878142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] PATH_INFO: `/v3/projects/9c48ff79ee7e41c484be81bc6962263c` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.878919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370f713-a49a-4c63-a774-676d588ce27f admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:06.879385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c48ff79ee7e41c484be81bc6962263c)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.881581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:06.884338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265d48a-0b61-4d8c-a88f-ebdefaa94290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:06.885079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265d48a-0b61-4d8c-a88f-ebdefaa94290 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:06.885397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265d48a-0b61-4d8c-a88f-ebdefaa94290 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:06.885707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265d48a-0b61-4d8c-a88f-ebdefaa94290 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:06.886919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265d48a-0b61-4d8c-a88f-ebdefaa94290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:06.889869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265d48a-0b61-4d8c-a88f-ebdefaa94290 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.019516 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1278/2572] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:06 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:07.020394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265d48a-0b61-4d8c-a88f-ebdefaa94290 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.031614 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265d48a-0b61-4d8c-a88f-ebdefaa94290 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.032990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c48ff79ee7e41c484be81bc6962263c', 'request_id': 'req-9009fa21-e89a-4063-b68a-68fbb5892cb7'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:07.041118 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c48ff79ee7e41c484be81bc6962263c', 'request_id': 'req-9009fa21-e89a-4063-b68a-68fbb5892cb7'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:07.047856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c48ff79ee7e41c484be81bc6962263c', 'request_id': 'req-9009fa21-e89a-4063-b68a-68fbb5892cb7'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:07.082509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:07.106318 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485e6e-bc45-43fd-8d06-8ec13792804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.107024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485e6e-bc45-43fd-8d06-8ec13792804a admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.107307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485e6e-bc45-43fd-8d06-8ec13792804a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.107607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485e6e-bc45-43fd-8d06-8ec13792804a admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.108305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d485e6e-bc45-43fd-8d06-8ec13792804a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.110281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d485e6e-bc45-43fd-8d06-8ec13792804a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.183850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] The token cache is being invalidate because project 9c48ff79ee7e41c484be81bc6962263c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:07.184363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:07.185026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:07.186868 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1295/2573] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:06 2022] DELETE /identity/v3/projects/9c48ff79ee7e41c484be81bc6962263c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:07.190805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.192224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:07.206505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009fa21-e89a-4063-b68a-68fbb5892cb7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.211968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c8c52-e2c2-416e-8f0b-cba6973c7b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.212663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c8c52-e2c2-416e-8f0b-cba6973c7b35 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.212956 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c8c52-e2c2-416e-8f0b-cba6973c7b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.213235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c8c52-e2c2-416e-8f0b-cba6973c7b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.213964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c8c52-e2c2-416e-8f0b-cba6973c7b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.215585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c8c52-e2c2-416e-8f0b-cba6973c7b35 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.227513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1296/2574] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:07.228850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24641bf-e854-4864-9793-a292529fd1da None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.229145 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24641bf-e854-4864-9793-a292529fd1da None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.229790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24641bf-e854-4864-9793-a292529fd1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.240443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1279/2575] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:07 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:07.241667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485e6e-bc45-43fd-8d06-8ec13792804a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.248171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e24641bf-e854-4864-9793-a292529fd1da None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:07.249383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e24641bf-e854-4864-9793-a292529fd1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:07.253009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485e6e-bc45-43fd-8d06-8ec13792804a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.258382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1297/2576] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:07.258535 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45e24-ecfc-4ea3-9b15-e640f6ed47d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.258999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24641bf-e854-4864-9793-a292529fd1da None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.259116 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45e24-ecfc-4ea3-9b15-e640f6ed47d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.259283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45e24-ecfc-4ea3-9b15-e640f6ed47d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.259590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45e24-ecfc-4ea3-9b15-e640f6ed47d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.260325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f45e24-ecfc-4ea3-9b15-e640f6ed47d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.260444 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e24641bf-e854-4864-9793-a292529fd1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:07.262258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f45e24-ecfc-4ea3-9b15-e640f6ed47d3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.272683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:07.280304 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24641bf-e854-4864-9793-a292529fd1da None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.291379 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1280/2577] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:07.293206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4955147-1b35-4381-9d7e-91096aa4c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.294136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4955147-1b35-4381-9d7e-91096aa4c022 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.294582 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4955147-1b35-4381-9d7e-91096aa4c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.295037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4955147-1b35-4381-9d7e-91096aa4c022 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.295983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4955147-1b35-4381-9d7e-91096aa4c022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.296143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45e24-ecfc-4ea3-9b15-e640f6ed47d3 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.298100 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4955147-1b35-4381-9d7e-91096aa4c022 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.309732 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45e24-ecfc-4ea3-9b15-e640f6ed47d3 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.311319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1298/2578] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:07.315478 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4955147-1b35-4381-9d7e-91096aa4c022 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.320494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd552932-63b1-41cd-b777-05fafaab5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.321584 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd552932-63b1-41cd-b777-05fafaab5995 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.321969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd552932-63b1-41cd-b777-05fafaab5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.322479 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd552932-63b1-41cd-b777-05fafaab5995 admin admin] PATH_INFO: `/v3/projects/be1613cfa81c4dd49f86293fbe860cf4/users/7354ccd8f03b478495dc437552cbee1e/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.328524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4955147-1b35-4381-9d7e-91096aa4c022 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.336163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3651bb-3170-49e2-863a-f1b013665db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.337091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3651bb-3170-49e2-863a-f1b013665db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.337383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3651bb-3170-49e2-863a-f1b013665db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.337658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3651bb-3170-49e2-863a-f1b013665db0 admin admin] PATH_INFO: `/v3/projects/c5e682e419e14ff3838c014fb1c2e89b/users/88ecdebc90b945babf358accb30cc234/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.344157 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd552932-63b1-41cd-b777-05fafaab5995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1613cfa81c4dd49f86293fbe860cf4, user_id=7354ccd8f03b478495dc437552cbee1e, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.346723 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd552932-63b1-41cd-b777-05fafaab5995 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.354049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3651bb-3170-49e2-863a-f1b013665db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e682e419e14ff3838c014fb1c2e89b, user_id=88ecdebc90b945babf358accb30cc234, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.357069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3651bb-3170-49e2-863a-f1b013665db0 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.420827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1281/2579] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:07 2022] PUT /identity/v3/projects/be1613cfa81c4dd49f86293fbe860cf4/users/7354ccd8f03b478495dc437552cbee1e/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:07.422156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073d6ed-1848-4418-8a94-578e2c721d0e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.422446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073d6ed-1848-4418-8a94-578e2c721d0e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.422708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073d6ed-1848-4418-8a94-578e2c721d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.440873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3073d6ed-1848-4418-8a94-578e2c721d0e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:07.442093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3073d6ed-1848-4418-8a94-578e2c721d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:07.448323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1299/2580] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:07 2022] PUT /identity/v3/projects/c5e682e419e14ff3838c014fb1c2e89b/users/88ecdebc90b945babf358accb30cc234/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:07.449702 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a418d-4566-450c-9243-4274b625355a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.449951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a418d-4566-450c-9243-4274b625355a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.451822 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a418d-4566-450c-9243-4274b625355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.476711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d12a418d-4566-450c-9243-4274b625355a None None] MFA Rules not processed for user `7354ccd8f03b478495dc437552cbee1e`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:07.477995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d12a418d-4566-450c-9243-4274b625355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:07.505927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1282/2581] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:07.506948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073d6ed-1848-4418-8a94-578e2c721d0e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.517913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073d6ed-1848-4418-8a94-578e2c721d0e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.522763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259792b-e767-46fe-9bbf-c904da9b57f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.524718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259792b-e767-46fe-9bbf-c904da9b57f3 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.524718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259792b-e767-46fe-9bbf-c904da9b57f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.524718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259792b-e767-46fe-9bbf-c904da9b57f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.524718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259792b-e767-46fe-9bbf-c904da9b57f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.526336 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259792b-e767-46fe-9bbf-c904da9b57f3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.537195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1283/2582] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:07.538219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259792b-e767-46fe-9bbf-c904da9b57f3 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.548639 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259792b-e767-46fe-9bbf-c904da9b57f3 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.553577 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb5325-b260-4f47-a44b-eed06a597866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.554588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb5325-b260-4f47-a44b-eed06a597866 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.555211 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb5325-b260-4f47-a44b-eed06a597866 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.555916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb5325-b260-4f47-a44b-eed06a597866 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.556766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb5325-b260-4f47-a44b-eed06a597866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:07.557148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb5325-b260-4f47-a44b-eed06a597866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.558882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb5325-b260-4f47-a44b-eed06a597866 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.570021 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1300/2583] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:07.570021 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a418d-4566-450c-9243-4274b625355a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.574585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1284/2584] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:07.575654 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb5325-b260-4f47-a44b-eed06a597866 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.585003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a418d-4566-450c-9243-4274b625355a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.592580 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6b3c4-7e83-4c7d-826e-ea2df3385646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.593476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6b3c4-7e83-4c7d-826e-ea2df3385646 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.599385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6b3c4-7e83-4c7d-826e-ea2df3385646 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.599385 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6b3c4-7e83-4c7d-826e-ea2df3385646 admin admin] PATH_INFO: `/v3/projects/c5e682e419e14ff3838c014fb1c2e89b/users/88ecdebc90b945babf358accb30cc234/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.599643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb5325-b260-4f47-a44b-eed06a597866 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.599784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6b3c4-7e83-4c7d-826e-ea2df3385646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e682e419e14ff3838c014fb1c2e89b, user_id=88ecdebc90b945babf358accb30cc234, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.599784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6b3c4-7e83-4c7d-826e-ea2df3385646 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.600182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99532557-e5b7-4acc-882e-3d359192b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.601258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532557-e5b7-4acc-882e-3d359192b700 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.601258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532557-e5b7-4acc-882e-3d359192b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.601725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532557-e5b7-4acc-882e-3d359192b700 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.602437 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99532557-e5b7-4acc-882e-3d359192b700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.604666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99532557-e5b7-4acc-882e-3d359192b700 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.611161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1301/2585] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:07 2022] PUT /identity/v3/projects/c5e682e419e14ff3838c014fb1c2e89b/users/88ecdebc90b945babf358accb30cc234/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:07.616620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6b3c4-7e83-4c7d-826e-ea2df3385646 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.695253 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6b3c4-7e83-4c7d-826e-ea2df3385646 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.700307 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eb820-050d-4d0d-8bae-a1b4bf06f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.700993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eb820-050d-4d0d-8bae-a1b4bf06f059 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.701276 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eb820-050d-4d0d-8bae-a1b4bf06f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.701547 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eb820-050d-4d0d-8bae-a1b4bf06f059 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.702233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eb820-050d-4d0d-8bae-a1b4bf06f059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.704201 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eb820-050d-4d0d-8bae-a1b4bf06f059 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.706321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1285/2586] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:07 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:07.710979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84cfbc-012f-473c-9332-fd122502d97d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.711268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84cfbc-012f-473c-9332-fd122502d97d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.711546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84cfbc-012f-473c-9332-fd122502d97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.737826 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ad84cfbc-012f-473c-9332-fd122502d97d None None] MFA Rules not processed for user `88ecdebc90b945babf358accb30cc234`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:07.739113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ad84cfbc-012f-473c-9332-fd122502d97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:07.807616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1302/2587] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:07 2022] POST /identity/v3/projects => generated 391 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:07.807616 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eb820-050d-4d0d-8bae-a1b4bf06f059 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.810849 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1286/2588] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:07.811880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84cfbc-012f-473c-9332-fd122502d97d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.879534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eb820-050d-4d0d-8bae-a1b4bf06f059 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.886308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84cfbc-012f-473c-9332-fd122502d97d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:07.886901 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e1689-ece6-4f74-89e2-53eb27044b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.887588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e1689-ece6-4f74-89e2-53eb27044b42 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.887931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e1689-ece6-4f74-89e2-53eb27044b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.888180 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e1689-ece6-4f74-89e2-53eb27044b42 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.888870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e1689-ece6-4f74-89e2-53eb27044b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.890778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e1689-ece6-4f74-89e2-53eb27044b42 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.891258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2595-a2ca-4305-b1ae-0b82cba55c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:07.891948 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2595-a2ca-4305-b1ae-0b82cba55c8a admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:07.892232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2595-a2ca-4305-b1ae-0b82cba55c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:07.892505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2595-a2ca-4305-b1ae-0b82cba55c8a admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:07.893447 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de2595-a2ca-4305-b1ae-0b82cba55c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:07.895967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de2595-a2ca-4305-b1ae-0b82cba55c8a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:07.898413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:07.965018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:07.971107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1303/2589] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:07 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:07.971955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e1689-ece6-4f74-89e2-53eb27044b42 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:07.974185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-303e1689-ece6-4f74-89e2-53eb27044b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:08.030845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e1689-ece6-4f74-89e2-53eb27044b42 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.032459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1287/2590] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:07 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:08.033391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2595-a2ca-4305-b1ae-0b82cba55c8a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.037940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f906-75e0-42be-9144-e208d60925f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.038648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f906-75e0-42be-9144-e208d60925f3 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.038938 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f906-75e0-42be-9144-e208d60925f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.039217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f906-75e0-42be-9144-e208d60925f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.043671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2595-a2ca-4305-b1ae-0b82cba55c8a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.048651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16318d05-b67a-4e06-a6d6-acb80b2d6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.049324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318d05-b67a-4e06-a6d6-acb80b2d6d8b admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.049606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318d05-b67a-4e06-a6d6-acb80b2d6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.049877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318d05-b67a-4e06-a6d6-acb80b2d6d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.050590 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16318d05-b67a-4e06-a6d6-acb80b2d6d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.053003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16318d05-b67a-4e06-a6d6-acb80b2d6d8b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.063279 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1288/2591] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:08.067343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16318d05-b67a-4e06-a6d6-acb80b2d6d8b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.077345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16318d05-b67a-4e06-a6d6-acb80b2d6d8b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.081915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55618926-73a3-4d00-bd50-c16338ea6dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.082563 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618926-73a3-4d00-bd50-c16338ea6dfa admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.082846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618926-73a3-4d00-bd50-c16338ea6dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.083148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618926-73a3-4d00-bd50-c16338ea6dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.083900 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55618926-73a3-4d00-bd50-c16338ea6dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.085552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55618926-73a3-4d00-bd50-c16338ea6dfa admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.096524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1289/2592] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:08.100888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55618926-73a3-4d00-bd50-c16338ea6dfa admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.110431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55618926-73a3-4d00-bd50-c16338ea6dfa admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.110937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631f906-75e0-42be-9144-e208d60925f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.112599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631f906-75e0-42be-9144-e208d60925f3 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.115888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea2271-092c-4be3-87e0-8157d818f67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.116751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea2271-092c-4be3-87e0-8157d818f67a admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.117035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea2271-092c-4be3-87e0-8157d818f67a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.117311 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea2271-092c-4be3-87e0-8157d818f67a admin admin] PATH_INFO: `/v3/projects/52938fd3b77e4b17be14bd26ba86e61c/users/025d3800db7a422f9b659b81dac9f123/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.123867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1304/2593] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:08.124841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f906-75e0-42be-9144-e208d60925f3 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.133321 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea2271-092c-4be3-87e0-8157d818f67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52938fd3b77e4b17be14bd26ba86e61c, user_id=025d3800db7a422f9b659b81dac9f123, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.135518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f906-75e0-42be-9144-e208d60925f3 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.136108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea2271-092c-4be3-87e0-8157d818f67a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.140886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a7482-7fc6-4c5d-ab92-7fffc1d6983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.141740 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a7482-7fc6-4c5d-ab92-7fffc1d6983d admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.142027 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a7482-7fc6-4c5d-ab92-7fffc1d6983d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.142302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a7482-7fc6-4c5d-ab92-7fffc1d6983d admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.143030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a7482-7fc6-4c5d-ab92-7fffc1d6983d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.144796 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a7482-7fc6-4c5d-ab92-7fffc1d6983d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.157384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1305/2594] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:08.162207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a7482-7fc6-4c5d-ab92-7fffc1d6983d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.172382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a7482-7fc6-4c5d-ab92-7fffc1d6983d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.177404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798ce3d-306f-43b0-8a05-726abaaf65c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.178284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798ce3d-306f-43b0-8a05-726abaaf65c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.178590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798ce3d-306f-43b0-8a05-726abaaf65c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.178866 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798ce3d-306f-43b0-8a05-726abaaf65c8 admin admin] PATH_INFO: `/v3/projects/66627441872c4d03842fcdfead69ebfc/users/3d67d98bfb9941a7a14c6b934a7b0781/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.194738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798ce3d-306f-43b0-8a05-726abaaf65c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66627441872c4d03842fcdfead69ebfc, user_id=3d67d98bfb9941a7a14c6b934a7b0781, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.197499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798ce3d-306f-43b0-8a05-726abaaf65c8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.281061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1290/2595] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:08 2022] PUT /identity/v3/projects/52938fd3b77e4b17be14bd26ba86e61c/users/025d3800db7a422f9b659b81dac9f123/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:08.284942 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea2271-092c-4be3-87e0-8157d818f67a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.311103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1306/2596] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:08 2022] PUT /identity/v3/projects/66627441872c4d03842fcdfead69ebfc/users/3d67d98bfb9941a7a14c6b934a7b0781/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:08.322532 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785c9f4-ae3b-4d3c-93c5-2a15b80a2d59 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.322816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785c9f4-ae3b-4d3c-93c5-2a15b80a2d59 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.323261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785c9f4-ae3b-4d3c-93c5-2a15b80a2d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.352373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-e785c9f4-ae3b-4d3c-93c5-2a15b80a2d59 None None] MFA Rules not processed for user `3d67d98bfb9941a7a14c6b934a7b0781`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:08.353707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e785c9f4-ae3b-4d3c-93c5-2a15b80a2d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:08.355229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea2271-092c-4be3-87e0-8157d818f67a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.416436 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4f5ba-150c-4fb7-8b48-ef146c1911c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.417316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4f5ba-150c-4fb7-8b48-ef146c1911c9 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.417756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4f5ba-150c-4fb7-8b48-ef146c1911c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.418159 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4f5ba-150c-4fb7-8b48-ef146c1911c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.419129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4f5ba-150c-4fb7-8b48-ef146c1911c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.421022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4f5ba-150c-4fb7-8b48-ef146c1911c9 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.427229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1307/2597] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:08.433895 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1291/2598] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:08.438506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785c9f4-ae3b-4d3c-93c5-2a15b80a2d59 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.443269 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4f5ba-150c-4fb7-8b48-ef146c1911c9 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.454441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4f5ba-150c-4fb7-8b48-ef146c1911c9 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.461364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:08.462358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449212c1-f9b3-4b4f-979c-143009ac00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.464306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449212c1-f9b3-4b4f-979c-143009ac00b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.468350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449212c1-f9b3-4b4f-979c-143009ac00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.468350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449212c1-f9b3-4b4f-979c-143009ac00b0 admin admin] PATH_INFO: `/v3/projects/52938fd3b77e4b17be14bd26ba86e61c/users/025d3800db7a422f9b659b81dac9f123/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.468350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449212c1-f9b3-4b4f-979c-143009ac00b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52938fd3b77e4b17be14bd26ba86e61c, user_id=025d3800db7a422f9b659b81dac9f123, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.470376 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449212c1-f9b3-4b4f-979c-143009ac00b0 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.483085 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1292/2599] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:08 2022] PUT /identity/v3/projects/52938fd3b77e4b17be14bd26ba86e61c/users/025d3800db7a422f9b659b81dac9f123/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:08.493476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbe908-ba3f-407f-a873-d25c8c8cb667 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.500783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbe908-ba3f-407f-a873-d25c8c8cb667 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.500783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbe908-ba3f-407f-a873-d25c8c8cb667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.503677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785c9f4-ae3b-4d3c-93c5-2a15b80a2d59 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.521955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-9fdbe908-ba3f-407f-a873-d25c8c8cb667 None None] MFA Rules not processed for user `025d3800db7a422f9b659b81dac9f123`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:08.523350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9fdbe908-ba3f-407f-a873-d25c8c8cb667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:08.555465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7c29c-ad37-4296-912f-7409e7358630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.556060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7c29c-ad37-4296-912f-7409e7358630 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.556341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7c29c-ad37-4296-912f-7409e7358630 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.556620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7c29c-ad37-4296-912f-7409e7358630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.598813 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1293/2600] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:08.619107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7c29c-ad37-4296-912f-7409e7358630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.620564 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7c29c-ad37-4296-912f-7409e7358630 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.629534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1308/2601] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:08.681400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbe908-ba3f-407f-a873-d25c8c8cb667 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:08.682788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9fdbe908-ba3f-407f-a873-d25c8c8cb667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:08.695617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:08.695906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbe908-ba3f-407f-a873-d25c8c8cb667 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:08.699435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77820f9b-722b-4d3b-af64-0f053e608711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:08.700107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77820f9b-722b-4d3b-af64-0f053e608711 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:08.700389 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77820f9b-722b-4d3b-af64-0f053e608711 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:08.701593 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77820f9b-722b-4d3b-af64-0f053e608711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:08.710477 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77820f9b-722b-4d3b-af64-0f053e608711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:08.711952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77820f9b-722b-4d3b-af64-0f053e608711 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:08.722187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1294/2602] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:08.760972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:09.172905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:09.265300 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7c29c-ad37-4296-912f-7409e7358630 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:09.274266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7c29c-ad37-4296-912f-7409e7358630 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:09.277953 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e691-c732-4441-900f-1e97cc14c828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:09.278615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e691-c732-4441-900f-1e97cc14c828 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:09.278946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e691-c732-4441-900f-1e97cc14c828 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:09.279218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e691-c732-4441-900f-1e97cc14c828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:09.342902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8e691-c732-4441-900f-1e97cc14c828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:09.342902 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8e691-c732-4441-900f-1e97cc14c828 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:09.347142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1309/2603] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:10.107250 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77820f9b-722b-4d3b-af64-0f053e608711 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:10.171481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77820f9b-722b-4d3b-af64-0f053e608711 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:10.176098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:10.177554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.177836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.178108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] PATH_INFO: `/v3/users/7354ccd8f03b478495dc437552cbee1e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.179291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7354ccd8f03b478495dc437552cbee1e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:10.181256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:10.399421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7354ccd8f03b478495dc437552cbee1e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:10.406146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7354ccd8f03b478495dc437552cbee1e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:10.406815 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7354ccd8f03b478495dc437552cbee1e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:10.419096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7354ccd8f03b478495dc437552cbee1e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:10.419779 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7354ccd8f03b478495dc437552cbee1e'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:10.503730 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1295/2604] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:10 2022] DELETE /identity/v3/users/7354ccd8f03b478495dc437552cbee1e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:10.508314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507e65-e77d-4e96-b9c7-5b3bfbd17c35 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.508805 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507e65-e77d-4e96-b9c7-5b3bfbd17c35 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.508901 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507e65-e77d-4e96-b9c7-5b3bfbd17c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.525835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-98507e65-e77d-4e96-b9c7-5b3bfbd17c35 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:10.527036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-98507e65-e77d-4e96-b9c7-5b3bfbd17c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:10.577420 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=100 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:10.589493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1310/2605] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:10.600144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:10.601591 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:10.653144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:10.669725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db8a26-78c4-4fdd-a0ab-f7a5e41f9c58 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:10.678735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2dbce-995a-47a7-a7e8-a714b9c97073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:10.678735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2dbce-995a-47a7-a7e8-a714b9c97073 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.678735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2dbce-995a-47a7-a7e8-a714b9c97073 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.678735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2dbce-995a-47a7-a7e8-a714b9c97073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.693610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2dbce-995a-47a7-a7e8-a714b9c97073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:10.695686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2dbce-995a-47a7-a7e8-a714b9c97073 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:10.707265 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1296/2606] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:10.858031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98507e65-e77d-4e96-b9c7-5b3bfbd17c35 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:10.869359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98507e65-e77d-4e96-b9c7-5b3bfbd17c35 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:10.872158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a9bb2-bf56-40b3-9787-3f62eb56a9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:10.872803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a9bb2-bf56-40b3-9787-3f62eb56a9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:10.873071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a9bb2-bf56-40b3-9787-3f62eb56a9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:10.873348 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a9bb2-bf56-40b3-9787-3f62eb56a9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:10.875179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-279a9bb2-bf56-40b3-9787-3f62eb56a9a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:10.887132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a9bb2-bf56-40b3-9787-3f62eb56a9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:10.888585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a9bb2-bf56-40b3-9787-3f62eb56a9a6 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:10.898909 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1311/2607] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:11.307704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2dbce-995a-47a7-a7e8-a714b9c97073 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:11.309371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5ee2dbce-995a-47a7-a7e8-a714b9c97073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:11.328606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2dbce-995a-47a7-a7e8-a714b9c97073 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:11.339170 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:11.340083 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:11.340370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:11.340662 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] PATH_INFO: `/v3/projects/be1613cfa81c4dd49f86293fbe860cf4` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:11.341882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1613cfa81c4dd49f86293fbe860cf4)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:11.344291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:11.466399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1613cfa81c4dd49f86293fbe860cf4', 'request_id': 'req-de451cf4-9359-487d-b03a-adb32fba1a12'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.474881 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1613cfa81c4dd49f86293fbe860cf4', 'request_id': 'req-de451cf4-9359-487d-b03a-adb32fba1a12'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.490190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1613cfa81c4dd49f86293fbe860cf4', 'request_id': 'req-de451cf4-9359-487d-b03a-adb32fba1a12'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.597965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] The token cache is being invalidate because project be1613cfa81c4dd49f86293fbe860cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:11.598275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.598963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:11.600578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1297/2608] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:11 2022] DELETE /identity/v3/projects/be1613cfa81c4dd49f86293fbe860cf4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:11.604531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a9bb2-bf56-40b3-9787-3f62eb56a9a6 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:11.615183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a9bb2-bf56-40b3-9787-3f62eb56a9a6 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:11.679012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:11.679865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:11.687372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:11.687372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] PATH_INFO: `/v3/users/025d3800db7a422f9b659b81dac9f123` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:11.687372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025d3800db7a422f9b659b81dac9f123)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:11.687372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:12.005984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025d3800db7a422f9b659b81dac9f123'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.125140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025d3800db7a422f9b659b81dac9f123'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.129465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025d3800db7a422f9b659b81dac9f123'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.146194 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025d3800db7a422f9b659b81dac9f123'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.147082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025d3800db7a422f9b659b81dac9f123'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.154247 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1312/2609] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:11 2022] DELETE /identity/v3/users/025d3800db7a422f9b659b81dac9f123 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:12.335110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:12.336867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:12.351077 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de451cf4-9359-487d-b03a-adb32fba1a12 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:12.415545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:12.416421 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.416707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.416984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] PATH_INFO: `/v3/users/2d6c7f7314dd46fe9710781c13bbe503` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.418497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6c7f7314dd46fe9710781c13bbe503)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:12.420660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:12.638450 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6c7f7314dd46fe9710781c13bbe503'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.646264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6c7f7314dd46fe9710781c13bbe503'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.646960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6c7f7314dd46fe9710781c13bbe503'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.652468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:12.659445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6c7f7314dd46fe9710781c13bbe503'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.660236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-03091362-d135-4b02-90f6-7225787c906e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6c7f7314dd46fe9710781c13bbe503'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.736220 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:12.743533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:12.762859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f4a5-4d7c-4faa-9861-886543d2d761 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:12.790298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:12.791785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.792076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.792356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] PATH_INFO: `/v3/projects/52938fd3b77e4b17be14bd26ba86e61c` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.794955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52938fd3b77e4b17be14bd26ba86e61c)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:12.799536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1298/2610] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:12 2022] DELETE /identity/v3/users/2d6c7f7314dd46fe9710781c13bbe503 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:12.803775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:12.804416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5362d2-ec07-419d-88a4-97a992f5732b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:12.804808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5362d2-ec07-419d-88a4-97a992f5732b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:12.805187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5362d2-ec07-419d-88a4-97a992f5732b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:12.827241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-fb5362d2-ec07-419d-88a4-97a992f5732b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:12.828675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fb5362d2-ec07-419d-88a4-97a992f5732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:12.897002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1299/2611] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:12.907105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5362d2-ec07-419d-88a4-97a992f5732b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:12.908828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fb5362d2-ec07-419d-88a4-97a992f5732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:12.964756 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52938fd3b77e4b17be14bd26ba86e61c', 'request_id': 'req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.972975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52938fd3b77e4b17be14bd26ba86e61c', 'request_id': 'req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:12.974324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:12.976155 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5362d2-ec07-419d-88a4-97a992f5732b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:12.979511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52938fd3b77e4b17be14bd26ba86e61c', 'request_id': 'req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:13.032989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f38b6-bc63-49ea-a26d-65714e4ba639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.033749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f38b6-bc63-49ea-a26d-65714e4ba639 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.036002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f38b6-bc63-49ea-a26d-65714e4ba639 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.036293 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f38b6-bc63-49ea-a26d-65714e4ba639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.079221 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] The token cache is being invalidate because project 52938fd3b77e4b17be14bd26ba86e61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:13.079513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:13.080224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-6418e475-f01f-4057-b65a-ac1bf3e0c9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:13.082007 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1313/2612] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:12 2022] DELETE /identity/v3/projects/52938fd3b77e4b17be14bd26ba86e61c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:13.086939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c3d15-8622-447c-b37d-97be3d44df68 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.087383 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c3d15-8622-447c-b37d-97be3d44df68 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.087904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c3d15-8622-447c-b37d-97be3d44df68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.111586 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-286c3d15-8622-447c-b37d-97be3d44df68 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:13.123636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-286c3d15-8622-447c-b37d-97be3d44df68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:13.132887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1314/2613] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:13.133092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f38b6-bc63-49ea-a26d-65714e4ba639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.133092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f38b6-bc63-49ea-a26d-65714e4ba639 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.135009 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cea369-d92d-4dee-a5e1-b328dcca901a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.135293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cea369-d92d-4dee-a5e1-b328dcca901a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.135685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cea369-d92d-4dee-a5e1-b328dcca901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.153833 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1300/2614] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:13.164722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-05cea369-d92d-4dee-a5e1-b328dcca901a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:13.166018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-05cea369-d92d-4dee-a5e1-b328dcca901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:13.176171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1315/2615] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:13.181360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f38b6-bc63-49ea-a26d-65714e4ba639 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.183129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c53f38b6-bc63-49ea-a26d-65714e4ba639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:13.197953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f38b6-bc63-49ea-a26d-65714e4ba639 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.204648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134763-4f5a-4100-88b5-9bd997114005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.205956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134763-4f5a-4100-88b5-9bd997114005 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.205956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134763-4f5a-4100-88b5-9bd997114005 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.206165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134763-4f5a-4100-88b5-9bd997114005 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.206799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134763-4f5a-4100-88b5-9bd997114005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:13.207189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134763-4f5a-4100-88b5-9bd997114005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.209270 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134763-4f5a-4100-88b5-9bd997114005 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.228812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cea369-d92d-4dee-a5e1-b328dcca901a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.229191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1301/2616] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:13.242853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cea369-d92d-4dee-a5e1-b328dcca901a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.249858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b0ff3-3085-46f3-b756-1f558f5ab672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.250592 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b0ff3-3085-46f3-b756-1f558f5ab672 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.250889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b0ff3-3085-46f3-b756-1f558f5ab672 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.251316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b0ff3-3085-46f3-b756-1f558f5ab672 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.252418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b0ff3-3085-46f3-b756-1f558f5ab672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.256117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b0ff3-3085-46f3-b756-1f558f5ab672 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.357851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:13.422802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1316/2617] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:13 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:13.424252 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134763-4f5a-4100-88b5-9bd997114005 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.434934 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134763-4f5a-4100-88b5-9bd997114005 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.497397 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552824d-9223-423f-b792-2fe8181e9785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.498374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552824d-9223-423f-b792-2fe8181e9785 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.498665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552824d-9223-423f-b792-2fe8181e9785 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.498947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552824d-9223-423f-b792-2fe8181e9785 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.499683 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552824d-9223-423f-b792-2fe8181e9785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.501662 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552824d-9223-423f-b792-2fe8181e9785 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.625350 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1302/2618] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:13 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:13.628810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b0ff3-3085-46f3-b756-1f558f5ab672 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.641149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b0ff3-3085-46f3-b756-1f558f5ab672 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.650712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db05561-2aa9-4b71-a8fc-660b80adec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.651853 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db05561-2aa9-4b71-a8fc-660b80adec65 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.652712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db05561-2aa9-4b71-a8fc-660b80adec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.652712 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db05561-2aa9-4b71-a8fc-660b80adec65 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.653921 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db05561-2aa9-4b71-a8fc-660b80adec65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.656879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db05561-2aa9-4b71-a8fc-660b80adec65 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.678793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1317/2619] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:13.682770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552824d-9223-423f-b792-2fe8181e9785 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.703429 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552824d-9223-423f-b792-2fe8181e9785 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.726623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db05561-2aa9-4b71-a8fc-660b80adec65 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.726623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2db05561-2aa9-4b71-a8fc-660b80adec65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:13.732626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7332a-1853-4f0a-8543-2b323ae87c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.733567 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7332a-1853-4f0a-8543-2b323ae87c75 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.734058 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7332a-1853-4f0a-8543-2b323ae87c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.734508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7332a-1853-4f0a-8543-2b323ae87c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.737865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7332a-1853-4f0a-8543-2b323ae87c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.741357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db05561-2aa9-4b71-a8fc-660b80adec65 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.748803 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.750214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.750214 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.750585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] PATH_INFO: `/v3/projects/a83da780cc3c4cae95338b18f09c1fae` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.752755 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83da780cc3c4cae95338b18f09c1fae)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.755710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.769756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7332a-1853-4f0a-8543-2b323ae87c75 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.784346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1303/2620] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:13.789119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7332a-1853-4f0a-8543-2b323ae87c75 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:13.800937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7332a-1853-4f0a-8543-2b323ae87c75 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:13.810161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418753c-1c72-4c44-8b57-a3222a49ef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:13.810958 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418753c-1c72-4c44-8b57-a3222a49ef25 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.811711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418753c-1c72-4c44-8b57-a3222a49ef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.811711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418753c-1c72-4c44-8b57-a3222a49ef25 admin admin] PATH_INFO: `/v3/projects/c4d6a0d6f4c4487f877744a1a95009d5/users/bb7726a79e934720a2785e39ba1cb864/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.830183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418753c-1c72-4c44-8b57-a3222a49ef25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d6a0d6f4c4487f877744a1a95009d5, user_id=bb7726a79e934720a2785e39ba1cb864, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:13.832905 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418753c-1c72-4c44-8b57-a3222a49ef25 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:13.939470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1304/2621] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:13 2022] PUT /identity/v3/projects/c4d6a0d6f4c4487f877744a1a95009d5/users/bb7726a79e934720a2785e39ba1cb864/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:13.946270 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83da780cc3c4cae95338b18f09c1fae', 'request_id': 'req-a13f6a21-05ee-4759-a258-e9c6119677ba'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:13.951129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f956-04e5-402f-ae43-bb4aff0c62f4 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:13.952611 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f956-04e5-402f-ae43-bb4aff0c62f4 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:13.952959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83da780cc3c4cae95338b18f09c1fae', 'request_id': 'req-a13f6a21-05ee-4759-a258-e9c6119677ba'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:13.953793 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f956-04e5-402f-ae43-bb4aff0c62f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:13.964433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83da780cc3c4cae95338b18f09c1fae', 'request_id': 'req-a13f6a21-05ee-4759-a258-e9c6119677ba'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:13.981874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-3150f956-04e5-402f-ae43-bb4aff0c62f4 None None] MFA Rules not processed for user `bb7726a79e934720a2785e39ba1cb864`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:13.983117 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3150f956-04e5-402f-ae43-bb4aff0c62f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:14.049875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1305/2622] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:14.054858 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150f956-04e5-402f-ae43-bb4aff0c62f4 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:14.105450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] The token cache is being invalidate because project a83da780cc3c4cae95338b18f09c1fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:14.105739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:14.106414 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:14.111707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1318/2623] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:13 2022] DELETE /identity/v3/projects/a83da780cc3c4cae95338b18f09c1fae => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:14.112287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:14.114723 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:14.143335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150f956-04e5-402f-ae43-bb4aff0c62f4 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:14.148292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ea154-e42d-4e11-92f9-a83b42d79746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:14.148964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ea154-e42d-4e11-92f9-a83b42d79746 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:14.149245 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ea154-e42d-4e11-92f9-a83b42d79746 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:14.149517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ea154-e42d-4e11-92f9-a83b42d79746 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:14.150227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ea154-e42d-4e11-92f9-a83b42d79746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:14.152192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ea154-e42d-4e11-92f9-a83b42d79746 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:14.183506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6a21-05ee-4759-a258-e9c6119677ba admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:14.188333 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:14.189256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:14.189536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:14.189814 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] PATH_INFO: `/v3/users/88ecdebc90b945babf358accb30cc234` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:14.191182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ecdebc90b945babf358accb30cc234)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:14.193299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:14.231390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:14.339293 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1306/2624] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:14 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:14.344719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ea154-e42d-4e11-92f9-a83b42d79746 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:14.349343 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-862ea154-e42d-4e11-92f9-a83b42d79746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:14.464926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:14.478925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ea154-e42d-4e11-92f9-a83b42d79746 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:14.484917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a7a9a-38b5-43ff-87a7-1fc87ff6cc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:14.485728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a7a9a-38b5-43ff-87a7-1fc87ff6cc55 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:14.486390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a7a9a-38b5-43ff-87a7-1fc87ff6cc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:14.486897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a7a9a-38b5-43ff-87a7-1fc87ff6cc55 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:14.489831 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a7a9a-38b5-43ff-87a7-1fc87ff6cc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:14.490695 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ecdebc90b945babf358accb30cc234'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:14.493316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a7a9a-38b5-43ff-87a7-1fc87ff6cc55 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:14.569150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ecdebc90b945babf358accb30cc234'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:14.578373 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ecdebc90b945babf358accb30cc234'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:14.594036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ecdebc90b945babf358accb30cc234'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:14.594874 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ecdebc90b945babf358accb30cc234'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:14.601450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1319/2625] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:14 2022] DELETE /identity/v3/users/88ecdebc90b945babf358accb30cc234 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:14.628188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1307/2626] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:14 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:14.633386 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:14.634995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:14.732082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735fa6-2569-4c37-bb3f-afcc0f77e5b4 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:14.737904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e8df5-d680-45d3-96dd-88bb54974b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:14.738662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e8df5-d680-45d3-96dd-88bb54974b1b admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:14.739088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e8df5-d680-45d3-96dd-88bb54974b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:14.739437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e8df5-d680-45d3-96dd-88bb54974b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:14.740279 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e8df5-d680-45d3-96dd-88bb54974b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:14.741973 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e8df5-d680-45d3-96dd-88bb54974b1b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:14.755945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1320/2627] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:14.758784 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a7a9a-38b5-43ff-87a7-1fc87ff6cc55 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:14.778798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a7a9a-38b5-43ff-87a7-1fc87ff6cc55 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:14.781403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6a925-b30b-454a-a852-321e5002fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:14.782422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6a925-b30b-454a-a852-321e5002fee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:14.782782 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6a925-b30b-454a-a852-321e5002fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:14.783068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6a925-b30b-454a-a852-321e5002fee7 admin admin] PATH_INFO: `/v3/projects/dd85adb0bd5c4381a91bd53adf7d3474/users/68336f33baa54e8c9f479d980fd8782d/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:14.802674 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6a925-b30b-454a-a852-321e5002fee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd85adb0bd5c4381a91bd53adf7d3474, user_id=68336f33baa54e8c9f479d980fd8782d, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:14.805298 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6a925-b30b-454a-a852-321e5002fee7 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:14.986233 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1308/2628] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:14 2022] PUT /identity/v3/projects/dd85adb0bd5c4381a91bd53adf7d3474/users/68336f33baa54e8c9f479d980fd8782d/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:14.990415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e8df5-d680-45d3-96dd-88bb54974b1b admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:15.000857 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e8df5-d680-45d3-96dd-88bb54974b1b admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:15.039438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6a925-b30b-454a-a852-321e5002fee7 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:15.041445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-82e6a925-b30b-454a-a852-321e5002fee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:15.073324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34ffe4-7fd2-4ba3-b9d4-ebc7090a7056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:15.074126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34ffe4-7fd2-4ba3-b9d4-ebc7090a7056 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:15.077139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34ffe4-7fd2-4ba3-b9d4-ebc7090a7056 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:15.077139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34ffe4-7fd2-4ba3-b9d4-ebc7090a7056 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:15.077139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34ffe4-7fd2-4ba3-b9d4-ebc7090a7056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:15.077139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34ffe4-7fd2-4ba3-b9d4-ebc7090a7056 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:15.093442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1321/2629] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:15.097465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34ffe4-7fd2-4ba3-b9d4-ebc7090a7056 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:15.107686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34ffe4-7fd2-4ba3-b9d4-ebc7090a7056 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:15.115762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770370e-2de7-44bd-96e0-002aac16e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:15.116798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770370e-2de7-44bd-96e0-002aac16e45f admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:15.117155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770370e-2de7-44bd-96e0-002aac16e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:15.117510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770370e-2de7-44bd-96e0-002aac16e45f admin admin] PATH_INFO: `/v3/projects/dd85adb0bd5c4381a91bd53adf7d3474/users/68336f33baa54e8c9f479d980fd8782d/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:15.119714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770370e-2de7-44bd-96e0-002aac16e45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd85adb0bd5c4381a91bd53adf7d3474, user_id=68336f33baa54e8c9f479d980fd8782d, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:15.122604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770370e-2de7-44bd-96e0-002aac16e45f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:15.128543 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6a925-b30b-454a-a852-321e5002fee7 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:15.135551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1322/2630] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:15 2022] PUT /identity/v3/projects/dd85adb0bd5c4381a91bd53adf7d3474/users/68336f33baa54e8c9f479d980fd8782d/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:15.146107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83233d2-15df-4bf3-9d49-1431471b4b5c None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:15.149294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83233d2-15df-4bf3-9d49-1431471b4b5c None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:15.149294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83233d2-15df-4bf3-9d49-1431471b4b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:15.176287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-b83233d2-15df-4bf3-9d49-1431471b4b5c None None] MFA Rules not processed for user `68336f33baa54e8c9f479d980fd8782d`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:15.178138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b83233d2-15df-4bf3-9d49-1431471b4b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:15.190027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:15.190937 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:15.191390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:15.191524 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] PATH_INFO: `/v3/users/bc0e583fb8414bde82872ccc4726e5e8` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:15.193536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0e583fb8414bde82872ccc4726e5e8)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:15.195631 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:15.252468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1323/2631] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:15.264769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83233d2-15df-4bf3-9d49-1431471b4b5c None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:15.266267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b83233d2-15df-4bf3-9d49-1431471b4b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:15.337230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83233d2-15df-4bf3-9d49-1431471b4b5c None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:15.337230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:15.337230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:15.337230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:15.337637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:15.340648 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:15.421274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:15.427036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:15.439740 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1324/2632] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:15.441065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:15.444573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:15.467686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788a40e-9019-43d0-830a-a2556395f9ba service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:15.474068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:15.474233 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0e583fb8414bde82872ccc4726e5e8'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.475649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:15.476103 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:15.476560 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] PATH_INFO: `/v3/projects/c5e682e419e14ff3838c014fb1c2e89b` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:15.478223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e682e419e14ff3838c014fb1c2e89b)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:15.480820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:15.482107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0e583fb8414bde82872ccc4726e5e8'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.484515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0e583fb8414bde82872ccc4726e5e8'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.514127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0e583fb8414bde82872ccc4726e5e8'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.519068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-0b6fabbd-5ef1-495c-bb3a-90e15d806bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0e583fb8414bde82872ccc4726e5e8'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.666648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1309/2633] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:15 2022] DELETE /identity/v3/users/bc0e583fb8414bde82872ccc4726e5e8 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:15.712518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e682e419e14ff3838c014fb1c2e89b', 'request_id': 'req-722f75ce-1b4c-4b18-9b7d-d16277a565b3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.726892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e682e419e14ff3838c014fb1c2e89b', 'request_id': 'req-722f75ce-1b4c-4b18-9b7d-d16277a565b3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.729773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e682e419e14ff3838c014fb1c2e89b', 'request_id': 'req-722f75ce-1b4c-4b18-9b7d-d16277a565b3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.826289 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:15.835147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] The token cache is being invalidate because project c5e682e419e14ff3838c014fb1c2e89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:15.836106 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.837069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-722f75ce-1b4c-4b18-9b7d-d16277a565b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:15.843365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1325/2634] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:15 2022] DELETE /identity/v3/projects/c5e682e419e14ff3838c014fb1c2e89b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:15.846652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c704ea-7218-4fe4-957c-8564602df4bc None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:15.847139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c704ea-7218-4fe4-957c-8564602df4bc None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:15.847473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c704ea-7218-4fe4-957c-8564602df4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:15.870265 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-e9c704ea-7218-4fe4-957c-8564602df4bc None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:15.871486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-e9c704ea-7218-4fe4-957c-8564602df4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:15.937413 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1310/2635] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:15.946176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931eca1-2141-4953-98fe-843ac4f61bc1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:15.946465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931eca1-2141-4953-98fe-843ac4f61bc1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:15.946741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931eca1-2141-4953-98fe-843ac4f61bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:15.968929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c931eca1-2141-4953-98fe-843ac4f61bc1 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:15.970410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c931eca1-2141-4953-98fe-843ac4f61bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:15.981185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1326/2636] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:15.985819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c704ea-7218-4fe4-957c-8564602df4bc None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:15.998179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931eca1-2141-4953-98fe-843ac4f61bc1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:15.999330 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c704ea-7218-4fe4-957c-8564602df4bc None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.000490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c931eca1-2141-4953-98fe-843ac4f61bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:16.006706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c604d79-b917-4c5c-b7fd-5b07ff7f1b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.008100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c604d79-b917-4c5c-b7fd-5b07ff7f1b95 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.011987 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c604d79-b917-4c5c-b7fd-5b07ff7f1b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.012843 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c604d79-b917-4c5c-b7fd-5b07ff7f1b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.013271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c604d79-b917-4c5c-b7fd-5b07ff7f1b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:16.013739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c604d79-b917-4c5c-b7fd-5b07ff7f1b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.016112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c604d79-b917-4c5c-b7fd-5b07ff7f1b95 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.032352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1311/2637] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:12:16.035752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931eca1-2141-4953-98fe-843ac4f61bc1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.036789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c604d79-b917-4c5c-b7fd-5b07ff7f1b95 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.041384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.042315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.042601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.042877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] PATH_INFO: `/v3/projects/12f0d5719c724f2eb6b4384c250764b6` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.044141 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f0d5719c724f2eb6b4384c250764b6)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.046524 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.048001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c604d79-b917-4c5c-b7fd-5b07ff7f1b95 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.053555 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb093-7b16-4368-a4f0-06217279fa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.054285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb093-7b16-4368-a4f0-06217279fa06 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.054571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb093-7b16-4368-a4f0-06217279fa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.054846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb093-7b16-4368-a4f0-06217279fa06 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.055538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcb093-7b16-4368-a4f0-06217279fa06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.057483 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcb093-7b16-4368-a4f0-06217279fa06 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.184275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1312/2638] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:16.194011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb093-7b16-4368-a4f0-06217279fa06 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.203886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f0d5719c724f2eb6b4384c250764b6', 'request_id': 'req-134156d8-3271-413e-9fb0-c5baffb8e7dc'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.210481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f0d5719c724f2eb6b4384c250764b6', 'request_id': 'req-134156d8-3271-413e-9fb0-c5baffb8e7dc'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.216733 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f0d5719c724f2eb6b4384c250764b6', 'request_id': 'req-134156d8-3271-413e-9fb0-c5baffb8e7dc'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.222960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:16.266017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb093-7b16-4368-a4f0-06217279fa06 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.270998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cf3ce-b778-40fb-a2d7-155357a740ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.271739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cf3ce-b778-40fb-a2d7-155357a740ad admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.272390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cf3ce-b778-40fb-a2d7-155357a740ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.272390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cf3ce-b778-40fb-a2d7-155357a740ad admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.273057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cf3ce-b778-40fb-a2d7-155357a740ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.274998 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cf3ce-b778-40fb-a2d7-155357a740ad admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.339246 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] The token cache is being invalidate because project 12f0d5719c724f2eb6b4384c250764b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:16.339542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.340229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-134156d8-3271-413e-9fb0-c5baffb8e7dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:16.342657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1327/2639] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:15 2022] DELETE /identity/v3/projects/12f0d5719c724f2eb6b4384c250764b6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:16.347844 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e2a9e-a107-49d0-bdd8-49f729a1de1e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.348718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e2a9e-a107-49d0-bdd8-49f729a1de1e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.349142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e2a9e-a107-49d0-bdd8-49f729a1de1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.368812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-ae9e2a9e-a107-49d0-bdd8-49f729a1de1e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:16.370037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ae9e2a9e-a107-49d0-bdd8-49f729a1de1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:16.378985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1328/2640] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:16.386642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fdf1e-056b-4953-9335-63e66c66580a None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.386940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fdf1e-056b-4953-9335-63e66c66580a None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.387207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fdf1e-056b-4953-9335-63e66c66580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.391101 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1313/2641] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:16.392288 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cf3ce-b778-40fb-a2d7-155357a740ad admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.394075 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ba2cf3ce-b778-40fb-a2d7-155357a740ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:16.406446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cf3ce-b778-40fb-a2d7-155357a740ad admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.409299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-186fdf1e-056b-4953-9335-63e66c66580a None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:16.410499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-186fdf1e-056b-4953-9335-63e66c66580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:16.412177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f93d3d-c9c0-4541-8286-5de1028db931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.412809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f93d3d-c9c0-4541-8286-5de1028db931 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.413187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f93d3d-c9c0-4541-8286-5de1028db931 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.413464 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f93d3d-c9c0-4541-8286-5de1028db931 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.414192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f93d3d-c9c0-4541-8286-5de1028db931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.415849 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f93d3d-c9c0-4541-8286-5de1028db931 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.419057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1329/2642] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:16.423397 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fdf1e-056b-4953-9335-63e66c66580a None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.429941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1314/2643] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:16.431250 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f93d3d-c9c0-4541-8286-5de1028db931 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.433810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fdf1e-056b-4953-9335-63e66c66580a None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.439404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f47e-715f-4174-bb3d-006b8a3f7d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.440167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f47e-715f-4174-bb3d-006b8a3f7d6a admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.440836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f47e-715f-4174-bb3d-006b8a3f7d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.440836 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f47e-715f-4174-bb3d-006b8a3f7d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.441416 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f93d3d-c9c0-4541-8286-5de1028db931 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.441550 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031f47e-715f-4174-bb3d-006b8a3f7d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:16.442112 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031f47e-715f-4174-bb3d-006b8a3f7d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.443754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031f47e-715f-4174-bb3d-006b8a3f7d6a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.446146 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d21f9-60fc-458c-aac7-8dff14b43e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.446885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d21f9-60fc-458c-aac7-8dff14b43e08 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.447142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d21f9-60fc-458c-aac7-8dff14b43e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.447449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d21f9-60fc-458c-aac7-8dff14b43e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.448208 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d21f9-60fc-458c-aac7-8dff14b43e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.449800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d21f9-60fc-458c-aac7-8dff14b43e08 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.457983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1330/2644] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:16.460907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f47e-715f-4174-bb3d-006b8a3f7d6a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.461398 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1315/2645] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:16.465223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d21f9-60fc-458c-aac7-8dff14b43e08 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.471166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f47e-715f-4174-bb3d-006b8a3f7d6a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.475655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d21f9-60fc-458c-aac7-8dff14b43e08 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.479542 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b8c2d-51bd-4067-9093-25b02686167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.480026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b8c2d-51bd-4067-9093-25b02686167d admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.480026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b8c2d-51bd-4067-9093-25b02686167d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.480360 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b8c2d-51bd-4067-9093-25b02686167d admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.480570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be40c3-22a3-478d-b255-b6bc9ae0dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.481488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be40c3-22a3-478d-b255-b6bc9ae0dd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.481696 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b8c2d-51bd-4067-9093-25b02686167d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.481818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be40c3-22a3-478d-b255-b6bc9ae0dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.482036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be40c3-22a3-478d-b255-b6bc9ae0dd30 admin admin] PATH_INFO: `/v3/projects/e6dfddcf291040b48fd22f9240e85eeb/users/b5bbe90340d847be9ca8ab7bd40e4f5f/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.483758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b8c2d-51bd-4067-9093-25b02686167d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.499034 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be40c3-22a3-478d-b255-b6bc9ae0dd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6dfddcf291040b48fd22f9240e85eeb, user_id=b5bbe90340d847be9ca8ab7bd40e4f5f, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.501879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be40c3-22a3-478d-b255-b6bc9ae0dd30 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.588473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1331/2646] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:16.592872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b8c2d-51bd-4067-9093-25b02686167d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.639632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1316/2647] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:16 2022] PUT /identity/v3/projects/e6dfddcf291040b48fd22f9240e85eeb/users/b5bbe90340d847be9ca8ab7bd40e4f5f/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:16.650507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0569c-e1dd-4194-8b6c-268c80490b01 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.650803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0569c-e1dd-4194-8b6c-268c80490b01 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.651090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0569c-e1dd-4194-8b6c-268c80490b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.654791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b8c2d-51bd-4067-9093-25b02686167d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.678738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-91c0569c-e1dd-4194-8b6c-268c80490b01 None None] MFA Rules not processed for user `b5bbe90340d847be9ca8ab7bd40e4f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:16.679989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-91c0569c-e1dd-4194-8b6c-268c80490b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:16.716186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb8837-0746-4bcb-99aa-bab87a7698df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.716856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb8837-0746-4bcb-99aa-bab87a7698df admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.717398 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb8837-0746-4bcb-99aa-bab87a7698df admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.720013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb8837-0746-4bcb-99aa-bab87a7698df admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.720013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb8837-0746-4bcb-99aa-bab87a7698df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.720360 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb8837-0746-4bcb-99aa-bab87a7698df admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.748087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1317/2648] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:16.752969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0569c-e1dd-4194-8b6c-268c80490b01 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.763755 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0569c-e1dd-4194-8b6c-268c80490b01 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.768342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cfbeb-d50d-4150-9f38-2a41c537b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.768984 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cfbeb-d50d-4150-9f38-2a41c537b653 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.769275 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cfbeb-d50d-4150-9f38-2a41c537b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.769641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cfbeb-d50d-4150-9f38-2a41c537b653 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.770846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cfbeb-d50d-4150-9f38-2a41c537b653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.772940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cfbeb-d50d-4150-9f38-2a41c537b653 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.846979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1332/2649] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/users => generated 303 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:16.852878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb8837-0746-4bcb-99aa-bab87a7698df admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.862753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb8837-0746-4bcb-99aa-bab87a7698df admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.867495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62f07d-9200-42d2-860a-1d89cc950c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.869207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62f07d-9200-42d2-860a-1d89cc950c81 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.869207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62f07d-9200-42d2-860a-1d89cc950c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.869207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62f07d-9200-42d2-860a-1d89cc950c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.869499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62f07d-9200-42d2-860a-1d89cc950c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.871172 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62f07d-9200-42d2-860a-1d89cc950c81 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.873390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1318/2650] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:16.877383 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cfbeb-d50d-4150-9f38-2a41c537b653 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.884597 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1333/2651] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:16.885644 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62f07d-9200-42d2-860a-1d89cc950c81 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.896302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62f07d-9200-42d2-860a-1d89cc950c81 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.942431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cfbeb-d50d-4150-9f38-2a41c537b653 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.947493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53aa1-1c83-40e1-9717-588db451b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.948226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53aa1-1c83-40e1-9717-588db451b9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.948874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53aa1-1c83-40e1-9717-588db451b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.948874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53aa1-1c83-40e1-9717-588db451b9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.949507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a53aa1-1c83-40e1-9717-588db451b9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.952193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a53aa1-1c83-40e1-9717-588db451b9f0 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.956461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df746b08-8628-46b7-a29b-5e3214986408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.957060 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df746b08-8628-46b7-a29b-5e3214986408 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.957341 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df746b08-8628-46b7-a29b-5e3214986408 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.958148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df746b08-8628-46b7-a29b-5e3214986408 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:16.958873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df746b08-8628-46b7-a29b-5e3214986408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:16.960498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df746b08-8628-46b7-a29b-5e3214986408 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:16.971244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1334/2652] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:16.976087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df746b08-8628-46b7-a29b-5e3214986408 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:16.985589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df746b08-8628-46b7-a29b-5e3214986408 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:16.989309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:16.990379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6ef0e-b685-4ab6-80b7-2968d81cd1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:16.991233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6ef0e-b685-4ab6-80b7-2968d81cd1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:16.991527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6ef0e-b685-4ab6-80b7-2968d81cd1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:16.991829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6ef0e-b685-4ab6-80b7-2968d81cd1f3 admin admin] PATH_INFO: `/v3/projects/125b65ab5cf8424cb70f07569d0db8ac/users/310b123adf2b4f3cb73f2204527d4056/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.007455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6ef0e-b685-4ab6-80b7-2968d81cd1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125b65ab5cf8424cb70f07569d0db8ac, user_id=310b123adf2b4f3cb73f2204527d4056, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.010179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6ef0e-b685-4ab6-80b7-2968d81cd1f3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.072955 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1319/2653] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:16 2022] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:17.076853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53aa1-1c83-40e1-9717-588db451b9f0 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.087115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53aa1-1c83-40e1-9717-588db451b9f0 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.092431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d003ea-bbcb-448f-8e1b-f9a5112dddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.093202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d003ea-bbcb-448f-8e1b-f9a5112dddb1 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.093446 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d003ea-bbcb-448f-8e1b-f9a5112dddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.093725 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d003ea-bbcb-448f-8e1b-f9a5112dddb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.094441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d003ea-bbcb-448f-8e1b-f9a5112dddb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.096090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d003ea-bbcb-448f-8e1b-f9a5112dddb1 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.109441 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1335/2654] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:16 2022] PUT /identity/v3/projects/125b65ab5cf8424cb70f07569d0db8ac/users/310b123adf2b4f3cb73f2204527d4056/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:17.109677 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1320/2655] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:17.116518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6ef0e-b685-4ab6-80b7-2968d81cd1f3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.120300 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57fb6-25ae-4cd2-ae41-1cd8027b02b9 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.120592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57fb6-25ae-4cd2-ae41-1cd8027b02b9 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.120874 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57fb6-25ae-4cd2-ae41-1cd8027b02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.151181 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c3e57fb6-25ae-4cd2-ae41-1cd8027b02b9 None None] MFA Rules not processed for user `310b123adf2b4f3cb73f2204527d4056`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:17.152938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c3e57fb6-25ae-4cd2-ae41-1cd8027b02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:17.186553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6ef0e-b685-4ab6-80b7-2968d81cd1f3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.193908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662eec-bedd-4d41-86b6-9f5a6ab7740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.195636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662eec-bedd-4d41-86b6-9f5a6ab7740d admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.196206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662eec-bedd-4d41-86b6-9f5a6ab7740d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.196830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662eec-bedd-4d41-86b6-9f5a6ab7740d admin admin] PATH_INFO: `/v3/projects/acf2502114c040f98c25a8a477a027ed/users/9bbd2e1eb57e40d1b2f55d4a46f40eae/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.218557 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12662eec-bedd-4d41-86b6-9f5a6ab7740d admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf2502114c040f98c25a8a477a027ed, user_id=9bbd2e1eb57e40d1b2f55d4a46f40eae, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.222085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12662eec-bedd-4d41-86b6-9f5a6ab7740d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.239035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1321/2656] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:17.243924 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e57fb6-25ae-4cd2-ae41-1cd8027b02b9 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.254258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e57fb6-25ae-4cd2-ae41-1cd8027b02b9 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.259326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc4071-6ead-492d-bbf9-f70bf6e41f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.260000 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc4071-6ead-492d-bbf9-f70bf6e41f66 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.260287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc4071-6ead-492d-bbf9-f70bf6e41f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.260562 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc4071-6ead-492d-bbf9-f70bf6e41f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.261274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc4071-6ead-492d-bbf9-f70bf6e41f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.263183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc4071-6ead-492d-bbf9-f70bf6e41f66 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.375041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1322/2658] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:17 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:17.375380 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1336/2658] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:17 2022] PUT /identity/v3/projects/acf2502114c040f98c25a8a477a027ed/users/9bbd2e1eb57e40d1b2f55d4a46f40eae/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:17.376739 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc4071-6ead-492d-bbf9-f70bf6e41f66 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.378111 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662eec-bedd-4d41-86b6-9f5a6ab7740d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.447685 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662eec-bedd-4d41-86b6-9f5a6ab7740d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.448032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc4071-6ead-492d-bbf9-f70bf6e41f66 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.452541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee18bd-5af7-49d2-a1cf-2fc6e59e663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.453209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee18bd-5af7-49d2-a1cf-2fc6e59e663a admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.453317 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505bbd-6e6f-41bc-b06f-c807f3dce170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.453492 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee18bd-5af7-49d2-a1cf-2fc6e59e663a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.453765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee18bd-5af7-49d2-a1cf-2fc6e59e663a admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.454140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505bbd-6e6f-41bc-b06f-c807f3dce170 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.454495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee18bd-5af7-49d2-a1cf-2fc6e59e663a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.454630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505bbd-6e6f-41bc-b06f-c807f3dce170 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.454939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505bbd-6e6f-41bc-b06f-c807f3dce170 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.455747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47505bbd-6e6f-41bc-b06f-c807f3dce170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.456131 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee18bd-5af7-49d2-a1cf-2fc6e59e663a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.458384 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47505bbd-6e6f-41bc-b06f-c807f3dce170 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.468045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1337/2659] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:17.472167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee18bd-5af7-49d2-a1cf-2fc6e59e663a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.482330 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee18bd-5af7-49d2-a1cf-2fc6e59e663a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.487135 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b4eb7-7225-4f8e-bbbd-0cf8bb63588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.490177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b4eb7-7225-4f8e-bbbd-0cf8bb63588c admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.490177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b4eb7-7225-4f8e-bbbd-0cf8bb63588c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.490177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b4eb7-7225-4f8e-bbbd-0cf8bb63588c admin admin] PATH_INFO: `/v3/projects/acf2502114c040f98c25a8a477a027ed/users/9bbd2e1eb57e40d1b2f55d4a46f40eae/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.490819 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b4eb7-7225-4f8e-bbbd-0cf8bb63588c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf2502114c040f98c25a8a477a027ed, user_id=9bbd2e1eb57e40d1b2f55d4a46f40eae, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.493506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b4eb7-7225-4f8e-bbbd-0cf8bb63588c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.503808 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1338/2660] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:17 2022] PUT /identity/v3/projects/acf2502114c040f98c25a8a477a027ed/users/9bbd2e1eb57e40d1b2f55d4a46f40eae/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:17.514764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d561bd-84d4-46c8-bf43-19256ad9df95 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.515062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d561bd-84d4-46c8-bf43-19256ad9df95 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.515338 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d561bd-84d4-46c8-bf43-19256ad9df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.542942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f6d561bd-84d4-46c8-bf43-19256ad9df95 None None] MFA Rules not processed for user `9bbd2e1eb57e40d1b2f55d4a46f40eae`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:17.544189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f6d561bd-84d4-46c8-bf43-19256ad9df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:17.604286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1323/2661] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:17 2022] POST /identity/v3/users => generated 309 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:17.605623 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505bbd-6e6f-41bc-b06f-c807f3dce170 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.613081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1339/2662] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:17.615829 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505bbd-6e6f-41bc-b06f-c807f3dce170 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.626079 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d561bd-84d4-46c8-bf43-19256ad9df95 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.627425 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f6d561bd-84d4-46c8-bf43-19256ad9df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:17.677890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc90c3-8f12-466e-a828-2a85b24aa6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.678694 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc90c3-8f12-466e-a828-2a85b24aa6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.678883 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc90c3-8f12-466e-a828-2a85b24aa6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.679161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc90c3-8f12-466e-a828-2a85b24aa6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.679926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc90c3-8f12-466e-a828-2a85b24aa6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.682015 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc90c3-8f12-466e-a828-2a85b24aa6e6 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.690789 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d561bd-84d4-46c8-bf43-19256ad9df95 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.694931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3873e9-6f13-4b46-9b06-ee1c67ac47a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.695623 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3873e9-6f13-4b46-9b06-ee1c67ac47a8 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.695916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3873e9-6f13-4b46-9b06-ee1c67ac47a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.696243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3873e9-6f13-4b46-9b06-ee1c67ac47a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.700326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1324/2663] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:17.701595 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc90c3-8f12-466e-a828-2a85b24aa6e6 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.711151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3873e9-6f13-4b46-9b06-ee1c67ac47a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.714325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3873e9-6f13-4b46-9b06-ee1c67ac47a8 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.715864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc90c3-8f12-466e-a828-2a85b24aa6e6 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.727944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c6c3b-c36c-4570-83b6-23e83b6e3a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.727944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6c3b-c36c-4570-83b6-23e83b6e3a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.727944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6c3b-c36c-4570-83b6-23e83b6e3a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.727944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6c3b-c36c-4570-83b6-23e83b6e3a75 admin admin] PATH_INFO: `/v3/projects/679acf8bdafb467ba048c121a190298e/users/59277e3822214c49b40ba37a7cd564d1/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.728342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1340/2664] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:17.740700 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c6c3b-c36c-4570-83b6-23e83b6e3a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679acf8bdafb467ba048c121a190298e, user_id=59277e3822214c49b40ba37a7cd564d1, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.743704 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c6c3b-c36c-4570-83b6-23e83b6e3a75 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.834662 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1325/2665] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:17 2022] PUT /identity/v3/projects/679acf8bdafb467ba048c121a190298e/users/59277e3822214c49b40ba37a7cd564d1/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:17.837718 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:17.839039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3873e9-6f13-4b46-9b06-ee1c67ac47a8 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.850183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3873e9-6f13-4b46-9b06-ee1c67ac47a8 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.855988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c6c3b-c36c-4570-83b6-23e83b6e3a75 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.909036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd6e3-fe8a-4ac0-8f9e-7798a92193e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.909625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd6e3-fe8a-4ac0-8f9e-7798a92193e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.909904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd6e3-fe8a-4ac0-8f9e-7798a92193e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.910174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd6e3-fe8a-4ac0-8f9e-7798a92193e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.910974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdd6e3-fe8a-4ac0-8f9e-7798a92193e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.912776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdd6e3-fe8a-4ac0-8f9e-7798a92193e9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.919342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c6c3b-c36c-4570-83b6-23e83b6e3a75 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.925967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1341/2666] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:17.926167 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.926167 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.926167 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.926167 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] PATH_INFO: `/v3/users/b5bbe90340d847be9ca8ab7bd40e4f5f` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.926893 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd6e3-fe8a-4ac0-8f9e-7798a92193e9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:17.927378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5bbe90340d847be9ca8ab7bd40e4f5f)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.929396 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.936696 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd6e3-fe8a-4ac0-8f9e-7798a92193e9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:17.944039 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8d1f1-27f4-4549-832f-3cfb64c2597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:17.944979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8d1f1-27f4-4549-832f-3cfb64c2597e admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.945282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8d1f1-27f4-4549-832f-3cfb64c2597e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.945555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8d1f1-27f4-4549-832f-3cfb64c2597e admin admin] PATH_INFO: `/v3/projects/679acf8bdafb467ba048c121a190298e/users/59277e3822214c49b40ba37a7cd564d1/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.947551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8d1f1-27f4-4549-832f-3cfb64c2597e admin admin] RBAC: Authorizing `identity:create_grant(project_id=679acf8bdafb467ba048c121a190298e, user_id=59277e3822214c49b40ba37a7cd564d1, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:17.950304 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8d1f1-27f4-4549-832f-3cfb64c2597e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:17.961460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1342/2667] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:17 2022] PUT /identity/v3/projects/679acf8bdafb467ba048c121a190298e/users/59277e3822214c49b40ba37a7cd564d1/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:17.971651 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cc39f-ef37-4898-af71-6768ad4a4bb4 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:17.971946 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cc39f-ef37-4898-af71-6768ad4a4bb4 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:17.972222 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cc39f-ef37-4898-af71-6768ad4a4bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:17.997802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-6d0cc39f-ef37-4898-af71-6768ad4a4bb4 None None] MFA Rules not processed for user `59277e3822214c49b40ba37a7cd564d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:17.998985 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6d0cc39f-ef37-4898-af71-6768ad4a4bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:18.068107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1343/2668] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:18.078661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cc39f-ef37-4898-af71-6768ad4a4bb4 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.133686 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cc39f-ef37-4898-af71-6768ad4a4bb4 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.137362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ef404-f69c-4dd0-bcbf-0e565a34fe9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.138006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef404-f69c-4dd0-bcbf-0e565a34fe9b service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.138288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef404-f69c-4dd0-bcbf-0e565a34fe9b service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.138563 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef404-f69c-4dd0-bcbf-0e565a34fe9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.147960 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ef404-f69c-4dd0-bcbf-0e565a34fe9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.149390 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ef404-f69c-4dd0-bcbf-0e565a34fe9b service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.159199 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1344/2669] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:18 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:18.198460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5bbe90340d847be9ca8ab7bd40e4f5f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.205722 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5bbe90340d847be9ca8ab7bd40e4f5f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.206424 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5bbe90340d847be9ca8ab7bd40e4f5f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.225471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5bbe90340d847be9ca8ab7bd40e4f5f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.226196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a9184eba-7bf2-4281-b1ae-2deb60cb02ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5bbe90340d847be9ca8ab7bd40e4f5f'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.304040 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ef404-f69c-4dd0-bcbf-0e565a34fe9b service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.367041 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ef404-f69c-4dd0-bcbf-0e565a34fe9b service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.371764 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.372774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1326/2670] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:17 2022] DELETE /identity/v3/users/b5bbe90340d847be9ca8ab7bd40e4f5f => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:18.372934 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.373042 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.373234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] PATH_INFO: `/v3/users/310b123adf2b4f3cb73f2204527d4056` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.374457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=310b123adf2b4f3cb73f2204527d4056)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.376457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.377071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8309-dd50-4f01-99b4-271dc2cf08c6 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.377357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8309-dd50-4f01-99b4-271dc2cf08c6 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.377655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8309-dd50-4f01-99b4-271dc2cf08c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.397178 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-abbb8309-dd50-4f01-99b4-271dc2cf08c6 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:18.398497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-abbb8309-dd50-4f01-99b4-271dc2cf08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:18.439053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:18.465672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1327/2671] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:18.476137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb8309-dd50-4f01-99b4-271dc2cf08c6 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.477496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-abbb8309-dd50-4f01-99b4-271dc2cf08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:18.534498 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb8309-dd50-4f01-99b4-271dc2cf08c6 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.538796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce71e4-faad-4094-bbb2-3a4e1d106b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.539433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce71e4-faad-4094-bbb2-3a4e1d106b5a service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.539748 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce71e4-faad-4094-bbb2-3a4e1d106b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.540020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce71e4-faad-4094-bbb2-3a4e1d106b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.548971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce71e4-faad-4094-bbb2-3a4e1d106b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.550458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce71e4-faad-4094-bbb2-3a4e1d106b5a service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.562711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1328/2672] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:18.731944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310b123adf2b4f3cb73f2204527d4056'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.754610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce71e4-faad-4094-bbb2-3a4e1d106b5a service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.758559 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-dbce71e4-faad-4094-bbb2-3a4e1d106b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:18.768762 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce71e4-faad-4094-bbb2-3a4e1d106b5a service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:18.773625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:18.774487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.774767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.775041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] PATH_INFO: `/v3/users/bb7726a79e934720a2785e39ba1cb864` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.776243 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7726a79e934720a2785e39ba1cb864)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:18.778204 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:18.843274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310b123adf2b4f3cb73f2204527d4056'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.845957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:18.853202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310b123adf2b4f3cb73f2204527d4056'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.867263 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310b123adf2b4f3cb73f2204527d4056'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.868011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f08b7a64-d220-401f-8942-df28bf3d1c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310b123adf2b4f3cb73f2204527d4056'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:18.874114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1345/2673] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:18 2022] DELETE /identity/v3/users/310b123adf2b4f3cb73f2204527d4056 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:18.878507 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac27e72-555b-402a-b853-c30c57e74917 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:18.878804 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac27e72-555b-402a-b853-c30c57e74917 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:18.879081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac27e72-555b-402a-b853-c30c57e74917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:18.896816 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-eac27e72-555b-402a-b853-c30c57e74917 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:18.898098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-eac27e72-555b-402a-b853-c30c57e74917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:18.959743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1346/2674] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:18.969660 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac27e72-555b-402a-b853-c30c57e74917 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:18.971004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-eac27e72-555b-402a-b853-c30c57e74917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:19.027298 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac27e72-555b-402a-b853-c30c57e74917 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:19.030986 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca183f-54e0-4b67-b695-534e6c115b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:19.031658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca183f-54e0-4b67-b695-534e6c115b52 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:19.031940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca183f-54e0-4b67-b695-534e6c115b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:19.032211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca183f-54e0-4b67-b695-534e6c115b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:19.042196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca183f-54e0-4b67-b695-534e6c115b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:19.043654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca183f-54e0-4b67-b695-534e6c115b52 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:19.044930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7726a79e934720a2785e39ba1cb864'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.051875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7726a79e934720a2785e39ba1cb864'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.052492 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7726a79e934720a2785e39ba1cb864'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.058635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1347/2675] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:19.062197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca183f-54e0-4b67-b695-534e6c115b52 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:19.064469 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-97ca183f-54e0-4b67-b695-534e6c115b52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:19.071461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7726a79e934720a2785e39ba1cb864'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.072249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-635972aa-b2fe-4191-b1c6-51a7e0c5ad30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7726a79e934720a2785e39ba1cb864'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.080635 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca183f-54e0-4b67-b695-534e6c115b52 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:19.085826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:19.086697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:19.087061 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:19.087699 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] PATH_INFO: `/v3/projects/e6dfddcf291040b48fd22f9240e85eeb` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:19.088861 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6dfddcf291040b48fd22f9240e85eeb)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:19.090798 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:19.244311 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1329/2676] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:18 2022] DELETE /identity/v3/users/bb7726a79e934720a2785e39ba1cb864 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:19.248756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f03326-77d3-4e9a-b129-6002c9f53549 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:19.249045 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f03326-77d3-4e9a-b129-6002c9f53549 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:19.249355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f03326-77d3-4e9a-b129-6002c9f53549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:19.257286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6dfddcf291040b48fd22f9240e85eeb', 'request_id': 'req-14e4efe0-345c-4268-a542-44c1f47113ae'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.263537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6dfddcf291040b48fd22f9240e85eeb', 'request_id': 'req-14e4efe0-345c-4268-a542-44c1f47113ae'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.267060 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-c9f03326-77d3-4e9a-b129-6002c9f53549 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:19.268296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c9f03326-77d3-4e9a-b129-6002c9f53549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:19.269202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6dfddcf291040b48fd22f9240e85eeb', 'request_id': 'req-14e4efe0-345c-4268-a542-44c1f47113ae'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.329515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1330/2677] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:19.341244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f03326-77d3-4e9a-b129-6002c9f53549 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:19.353191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c9f03326-77d3-4e9a-b129-6002c9f53549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:19.390908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] The token cache is being invalidate because project e6dfddcf291040b48fd22f9240e85eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:19.391431 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.392139 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.393772 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1348/2678] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:19 2022] DELETE /identity/v3/projects/e6dfddcf291040b48fd22f9240e85eeb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:19.398293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:19.400599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:19.403996 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f03326-77d3-4e9a-b129-6002c9f53549 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:19.408066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:19.408742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:19.409053 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:19.409326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:19.411430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:19.425162 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:19.427434 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:19.439003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1331/2679] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:19.473083 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4efe0-345c-4268-a542-44c1f47113ae admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:19.478403 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:19.479485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:19.480315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:19.480658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] PATH_INFO: `/v3/users/9bbd2e1eb57e40d1b2f55d4a46f40eae` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:19.481962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbd2e1eb57e40d1b2f55d4a46f40eae)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:19.484005 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:19.562994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:19.601202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:19.602796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:19.617652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8cdfd-645e-489d-b45f-aa612e551039 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:19.630227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:19.630227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:19.630227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:19.630227 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] PATH_INFO: `/v3/projects/125b65ab5cf8424cb70f07569d0db8ac` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:19.632036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125b65ab5cf8424cb70f07569d0db8ac)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:19.634803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:19.737401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbd2e1eb57e40d1b2f55d4a46f40eae'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.765835 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125b65ab5cf8424cb70f07569d0db8ac', 'request_id': 'req-76664ae9-bd05-4aa7-84e5-20e8a2de7788'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.773419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125b65ab5cf8424cb70f07569d0db8ac', 'request_id': 'req-76664ae9-bd05-4aa7-84e5-20e8a2de7788'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.779493 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125b65ab5cf8424cb70f07569d0db8ac', 'request_id': 'req-76664ae9-bd05-4aa7-84e5-20e8a2de7788'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.820449 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbd2e1eb57e40d1b2f55d4a46f40eae'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.828658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbd2e1eb57e40d1b2f55d4a46f40eae'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.841296 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbd2e1eb57e40d1b2f55d4a46f40eae'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.842292 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbd2e1eb57e40d1b2f55d4a46f40eae'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.849496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1349/2680] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:19 2022] DELETE /identity/v3/users/9bbd2e1eb57e40d1b2f55d4a46f40eae => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:19.932359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] The token cache is being invalidate because project 125b65ab5cf8424cb70f07569d0db8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:19.933790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.933790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:19.935187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1332/2681] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:19 2022] DELETE /identity/v3/projects/125b65ab5cf8424cb70f07569d0db8ac => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:19.939032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:19.940516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:20.007668 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802a028-79bb-45a0-a494-bb23214445a6 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:20.012308 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:20.013167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:20.013456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:20.013731 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] PATH_INFO: `/v3/users/59277e3822214c49b40ba37a7cd564d1` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:20.014916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59277e3822214c49b40ba37a7cd564d1)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:20.016950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:20.054431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:20.054431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:20.122024 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76664ae9-bd05-4aa7-84e5-20e8a2de7788 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:20.127023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:20.127914 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:20.128196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:20.128466 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] PATH_INFO: `/v3/projects/c4d6a0d6f4c4487f877744a1a95009d5` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:20.130158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d6a0d6f4c4487f877744a1a95009d5)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:20.132122 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:20.283078 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59277e3822214c49b40ba37a7cd564d1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.323013 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d6a0d6f4c4487f877744a1a95009d5', 'request_id': 'req-6258ee4f-54b2-44e7-accc-941eea3ea650'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.329622 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d6a0d6f4c4487f877744a1a95009d5', 'request_id': 'req-6258ee4f-54b2-44e7-accc-941eea3ea650'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.335193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d6a0d6f4c4487f877744a1a95009d5', 'request_id': 'req-6258ee4f-54b2-44e7-accc-941eea3ea650'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.404195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59277e3822214c49b40ba37a7cd564d1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.416268 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59277e3822214c49b40ba37a7cd564d1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.428627 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59277e3822214c49b40ba37a7cd564d1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.429346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59277e3822214c49b40ba37a7cd564d1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.435321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1350/2682] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:19 2022] DELETE /identity/v3/users/59277e3822214c49b40ba37a7cd564d1 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:20.438366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:20.438366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:20.505218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8e6ff-472c-435b-9e2b-81c9ebbeaa47 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:20.510785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:20.511682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:20.511990 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:20.512267 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] PATH_INFO: `/v3/projects/acf2502114c040f98c25a8a477a027ed` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:20.513473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf2502114c040f98c25a8a477a027ed)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:20.515426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:20.532698 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] The token cache is being invalidate because project c4d6a0d6f4c4487f877744a1a95009d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:20.536917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.536917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.536917 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1333/2683] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:20 2022] DELETE /identity/v3/projects/c4d6a0d6f4c4487f877744a1a95009d5 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:20.543817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:20.545236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:20.610090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ee4f-54b2-44e7-accc-941eea3ea650 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:20.615687 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:20.616559 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:20.617065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:20.617266 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] PATH_INFO: `/v3/users/68336f33baa54e8c9f479d980fd8782d` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:20.618468 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68336f33baa54e8c9f479d980fd8782d)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:20.620502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:20.657553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf2502114c040f98c25a8a477a027ed', 'request_id': 'req-f73d44db-df1e-42c8-acf5-82a923551619'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.664483 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf2502114c040f98c25a8a477a027ed', 'request_id': 'req-f73d44db-df1e-42c8-acf5-82a923551619'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.670589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf2502114c040f98c25a8a477a027ed', 'request_id': 'req-f73d44db-df1e-42c8-acf5-82a923551619'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.723969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:20.757681 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] The token cache is being invalidate because project acf2502114c040f98c25a8a477a027ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:20.757979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.758638 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f73d44db-df1e-42c8-acf5-82a923551619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.760251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1351/2684] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:20 2022] DELETE /identity/v3/projects/acf2502114c040f98c25a8a477a027ed => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:20.763066 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:20.765174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667900d7-bafc-481b-81b9-1f41507a4d8f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:20.765748 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667900d7-bafc-481b-81b9-1f41507a4d8f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:20.766028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667900d7-bafc-481b-81b9-1f41507a4d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:20.784930 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-667900d7-bafc-481b-81b9-1f41507a4d8f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:20.786157 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-667900d7-bafc-481b-81b9-1f41507a4d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:20.846362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1352/2685] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:20.854183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c4ee8-d319-4278-a961-fcf953f27027 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:20.854477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c4ee8-d319-4278-a961-fcf953f27027 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:20.854765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c4ee8-d319-4278-a961-fcf953f27027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:20.862648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68336f33baa54e8c9f479d980fd8782d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.868738 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68336f33baa54e8c9f479d980fd8782d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.869454 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68336f33baa54e8c9f479d980fd8782d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.872793 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-338c4ee8-d319-4278-a961-fcf953f27027 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:20.874045 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-338c4ee8-d319-4278-a961-fcf953f27027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:20.882657 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68336f33baa54e8c9f479d980fd8782d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.883053 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1353/2686] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:20.883509 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68336f33baa54e8c9f479d980fd8782d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:20.886992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c4ee8-d319-4278-a961-fcf953f27027 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:20.903213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c4ee8-d319-4278-a961-fcf953f27027 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:20.903213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:20.903213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:20.903740 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:20.903852 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:20.904509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:20.904896 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:20.906531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:20.922185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1354/2687] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:12:20.922185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:20.922185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:20.936136 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d11ff-d71e-4473-be60-68cb94338a7a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:20.941304 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:20.942729 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:20.954446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:20.954446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] PATH_INFO: `/v3/projects/679acf8bdafb467ba048c121a190298e` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:20.954446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679acf8bdafb467ba048c121a190298e)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:20.954446 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.031115 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1334/2688] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:20 2022] DELETE /identity/v3/users/68336f33baa54e8c9f479d980fd8782d => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:21.031972 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.033323 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.074802 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679acf8bdafb467ba048c121a190298e', 'request_id': 'req-b808fe03-45d5-450d-b470-117f5d67b320'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.083364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679acf8bdafb467ba048c121a190298e', 'request_id': 'req-b808fe03-45d5-450d-b470-117f5d67b320'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.089746 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679acf8bdafb467ba048c121a190298e', 'request_id': 'req-b808fe03-45d5-450d-b470-117f5d67b320'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.102686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b359d5-b649-4d20-aa72-de3b90e70c8e admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:21.163916 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0f3aa-d0c6-439b-bf2d-31694f999925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:21.164578 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0f3aa-d0c6-439b-bf2d-31694f999925 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.164866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0f3aa-d0c6-439b-bf2d-31694f999925 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.165143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0f3aa-d0c6-439b-bf2d-31694f999925 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.165834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0f3aa-d0c6-439b-bf2d-31694f999925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:21.167788 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0f3aa-d0c6-439b-bf2d-31694f999925 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.214238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] The token cache is being invalidate because project 679acf8bdafb467ba048c121a190298e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:21.214536 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.215182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.216779 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1355/2689] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:20 2022] DELETE /identity/v3/projects/679acf8bdafb467ba048c121a190298e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:21.217834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.219171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.231984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808fe03-45d5-450d-b470-117f5d67b320 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:21.236943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:21.237833 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.238123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.238408 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] PATH_INFO: `/v3/users/3d67d98bfb9941a7a14c6b934a7b0781` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.241181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d67d98bfb9941a7a14c6b934a7b0781)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:21.243639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.297667 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1335/2690] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:21 2022] POST /identity/v3/projects => generated 383 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:21.303369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309650af-ac7a-49fa-902a-46fcb5471c7f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.303690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309650af-ac7a-49fa-902a-46fcb5471c7f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.304156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309650af-ac7a-49fa-902a-46fcb5471c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.324511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-309650af-ac7a-49fa-902a-46fcb5471c7f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:21.326071 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-309650af-ac7a-49fa-902a-46fcb5471c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.389082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1336/2691] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:21.391869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309650af-ac7a-49fa-902a-46fcb5471c7f None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.393158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-309650af-ac7a-49fa-902a-46fcb5471c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.405706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309650af-ac7a-49fa-902a-46fcb5471c7f None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:21.411072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de7cde-d1df-4700-b48c-0de289280fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:21.412119 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7cde-d1df-4700-b48c-0de289280fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.412579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7cde-d1df-4700-b48c-0de289280fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.413065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7cde-d1df-4700-b48c-0de289280fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.414244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de7cde-d1df-4700-b48c-0de289280fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:21.417585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de7cde-d1df-4700-b48c-0de289280fa4 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.471826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d67d98bfb9941a7a14c6b934a7b0781'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.565339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1337/2692] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:21 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:21.565339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ed6a-588f-40b2-9343-9d79eed90591 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.565339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ed6a-588f-40b2-9343-9d79eed90591 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.565339 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ed6a-588f-40b2-9343-9d79eed90591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.572323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d67d98bfb9941a7a14c6b934a7b0781'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.582525 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d67d98bfb9941a7a14c6b934a7b0781'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.661242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-42b2ed6a-588f-40b2-9343-9d79eed90591 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:21.661242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-42b2ed6a-588f-40b2-9343-9d79eed90591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.661996 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d67d98bfb9941a7a14c6b934a7b0781'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.662088 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1338/2693] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:21.662179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d67d98bfb9941a7a14c6b934a7b0781'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.662260 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2ed6a-588f-40b2-9343-9d79eed90591 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.662260 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-42b2ed6a-588f-40b2-9343-9d79eed90591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.662413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1356/2694] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:21 2022] DELETE /identity/v3/users/3d67d98bfb9941a7a14c6b934a7b0781 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:21.662413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.662413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.662633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2ed6a-588f-40b2-9343-9d79eed90591 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:21.683706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538f6d0-d9f0-4f4a-8654-d9826261a6ba admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:21.684780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:21.689393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.689393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.689393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] PATH_INFO: `/v3/projects/dd85adb0bd5c4381a91bd53adf7d3474` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.690882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd85adb0bd5c4381a91bd53adf7d3474)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:21.692910 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.694494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a4f47-839e-4f87-8603-cae050b5ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:21.695163 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4f47-839e-4f87-8603-cae050b5ec83 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.695443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4f47-839e-4f87-8603-cae050b5ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.695765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4f47-839e-4f87-8603-cae050b5ec83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.696513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a4f47-839e-4f87-8603-cae050b5ec83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:21.698096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a4f47-839e-4f87-8603-cae050b5ec83 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.708818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1357/2695] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:21.708818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f87d8f-01e2-464d-a627-f43b793bd47f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.708818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f87d8f-01e2-464d-a627-f43b793bd47f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.708818 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f87d8f-01e2-464d-a627-f43b793bd47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.729367 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c6f87d8f-01e2-464d-a627-f43b793bd47f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:21.730556 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c6f87d8f-01e2-464d-a627-f43b793bd47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.738387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1358/2696] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:21.740137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f87d8f-01e2-464d-a627-f43b793bd47f None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.741588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c6f87d8f-01e2-464d-a627-f43b793bd47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.753417 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f87d8f-01e2-464d-a627-f43b793bd47f None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:21.758046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95145d9a-4b78-488d-8587-f464f971d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:21.758682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95145d9a-4b78-488d-8587-f464f971d43f admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.758991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95145d9a-4b78-488d-8587-f464f971d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.759261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95145d9a-4b78-488d-8587-f464f971d43f admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.759997 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95145d9a-4b78-488d-8587-f464f971d43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:21.760328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95145d9a-4b78-488d-8587-f464f971d43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:21.761906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95145d9a-4b78-488d-8587-f464f971d43f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.773538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1359/2697] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:21.774343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95145d9a-4b78-488d-8587-f464f971d43f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.787862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95145d9a-4b78-488d-8587-f464f971d43f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:21.789038 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebef78-c026-427a-bc8f-890a14c33eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:21.789684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebef78-c026-427a-bc8f-890a14c33eca admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.789968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebef78-c026-427a-bc8f-890a14c33eca admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.790236 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebef78-c026-427a-bc8f-890a14c33eca admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.790944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebef78-c026-427a-bc8f-890a14c33eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:21.792555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebef78-c026-427a-bc8f-890a14c33eca admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.803751 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1360/2698] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:21.804537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebef78-c026-427a-bc8f-890a14c33eca admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.806382 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c7ebef78-c026-427a-bc8f-890a14c33eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.825502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd85adb0bd5c4381a91bd53adf7d3474', 'request_id': 'req-cec4e1a8-a418-42c9-8485-190827248319'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.831962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd85adb0bd5c4381a91bd53adf7d3474', 'request_id': 'req-cec4e1a8-a418-42c9-8485-190827248319'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.837070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:21.837799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd85adb0bd5c4381a91bd53adf7d3474', 'request_id': 'req-cec4e1a8-a418-42c9-8485-190827248319'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.868006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebef78-c026-427a-bc8f-890a14c33eca admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:21.911822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] The token cache is being invalidate because project dd85adb0bd5c4381a91bd53adf7d3474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:21.912431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.912960 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:21.914554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1339/2699] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:21 2022] DELETE /identity/v3/projects/dd85adb0bd5c4381a91bd53adf7d3474 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:21.917392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:21.918269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.918875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.919209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.919806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.921134 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.921250 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:21.985837 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:21.987263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4e1a8-a418-42c9-8485-190827248319 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:21.987389 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.992650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f293f5-c522-4111-9d83-f16fc584e968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:21.993357 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f293f5-c522-4111-9d83-f16fc584e968 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:21.993644 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f293f5-c522-4111-9d83-f16fc584e968 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:21.993918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f293f5-c522-4111-9d83-f16fc584e968 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:21.994610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f293f5-c522-4111-9d83-f16fc584e968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:21.996636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f293f5-c522-4111-9d83-f16fc584e968 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:21.997063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1361/2700] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:21.997920 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:21.999318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:22.011183 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8b67c-2374-4fb5-8a7e-40ee2eb35850 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.016500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01816e-617a-4ae6-83df-bce63677f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.030769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01816e-617a-4ae6-83df-bce63677f9cb admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.030769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01816e-617a-4ae6-83df-bce63677f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.030769 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01816e-617a-4ae6-83df-bce63677f9cb admin admin] PATH_INFO: `/v3/projects/cc22f342bfe84f1da1959001eec2148b/users/4544b9f6488a466084c0b8118bc7bf48/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.034205 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01816e-617a-4ae6-83df-bce63677f9cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc22f342bfe84f1da1959001eec2148b, user_id=4544b9f6488a466084c0b8118bc7bf48, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.037657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01816e-617a-4ae6-83df-bce63677f9cb admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.122121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1362/2701] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:21 2022] PUT /identity/v3/projects/cc22f342bfe84f1da1959001eec2148b/users/4544b9f6488a466084c0b8118bc7bf48/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:22.125989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1340/2702] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:21 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:22.126126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e27f4-5ec7-4193-a403-bccd9fd50f94 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.126126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e27f4-5ec7-4193-a403-bccd9fd50f94 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.126126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e27f4-5ec7-4193-a403-bccd9fd50f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.126745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f293f5-c522-4111-9d83-f16fc584e968 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.141974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-aa8e27f4-5ec7-4193-a403-bccd9fd50f94 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:22.143490 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-aa8e27f4-5ec7-4193-a403-bccd9fd50f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:22.189090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f293f5-c522-4111-9d83-f16fc584e968 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.193803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772779c-8527-4fee-978b-1e1ee7784e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.194475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772779c-8527-4fee-978b-1e1ee7784e78 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.194763 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772779c-8527-4fee-978b-1e1ee7784e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.195047 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772779c-8527-4fee-978b-1e1ee7784e78 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.195767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772779c-8527-4fee-978b-1e1ee7784e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.197710 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772779c-8527-4fee-978b-1e1ee7784e78 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.204801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1363/2703] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:22.206346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e990d-e4d8-4926-a769-f6b45aee50cc None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.207945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e990d-e4d8-4926-a769-f6b45aee50cc None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.208328 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e990d-e4d8-4926-a769-f6b45aee50cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.235359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-817e990d-e4d8-4926-a769-f6b45aee50cc None None] MFA Rules not processed for user `4544b9f6488a466084c0b8118bc7bf48`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:22.236581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-817e990d-e4d8-4926-a769-f6b45aee50cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:22.302090 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1364/2704] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:22.302764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:22.303730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acf48-4d6a-43de-bc0b-a2ed667b0b4f None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.304016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acf48-4d6a-43de-bc0b-a2ed667b0b4f None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.304286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acf48-4d6a-43de-bc0b-a2ed667b0b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.313059 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1341/2705] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:22 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:22.314229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772779c-8527-4fee-978b-1e1ee7784e78 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.317820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-c772779c-8527-4fee-978b-1e1ee7784e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:22.327269 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d79acf48-4d6a-43de-bc0b-a2ed667b0b4f None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:22.328825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d79acf48-4d6a-43de-bc0b-a2ed667b0b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:22.337711 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1365/2706] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:22.339261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79acf48-4d6a-43de-bc0b-a2ed667b0b4f None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.349605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79acf48-4d6a-43de-bc0b-a2ed667b0b4f None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.354573 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440d594-6fd7-4cbd-b0b7-177cb736dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.355468 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440d594-6fd7-4cbd-b0b7-177cb736dedf admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.355825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440d594-6fd7-4cbd-b0b7-177cb736dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.355825 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440d594-6fd7-4cbd-b0b7-177cb736dedf admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.356617 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440d594-6fd7-4cbd-b0b7-177cb736dedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.358363 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440d594-6fd7-4cbd-b0b7-177cb736dedf admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.370461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1366/2707] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:22.370461 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440d594-6fd7-4cbd-b0b7-177cb736dedf admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.383125 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440d594-6fd7-4cbd-b0b7-177cb736dedf admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.388032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77988181-8bf0-4d16-b88d-bd56ba3c244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.388607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77988181-8bf0-4d16-b88d-bd56ba3c244e admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.388897 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77988181-8bf0-4d16-b88d-bd56ba3c244e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.389189 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77988181-8bf0-4d16-b88d-bd56ba3c244e admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.389904 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77988181-8bf0-4d16-b88d-bd56ba3c244e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:22.390140 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772779c-8527-4fee-978b-1e1ee7784e78 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.390251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77988181-8bf0-4d16-b88d-bd56ba3c244e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.391935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77988181-8bf0-4d16-b88d-bd56ba3c244e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.394706 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941f15e-a67b-4a99-a03b-02ecdd6dc13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.395961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941f15e-a67b-4a99-a03b-02ecdd6dc13f service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.396263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941f15e-a67b-4a99-a03b-02ecdd6dc13f service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.396530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941f15e-a67b-4a99-a03b-02ecdd6dc13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.405534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941f15e-a67b-4a99-a03b-02ecdd6dc13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.407087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941f15e-a67b-4a99-a03b-02ecdd6dc13f service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.411325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1367/2708] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:22.412797 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77988181-8bf0-4d16-b88d-bd56ba3c244e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.417001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1342/2709] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:22.417962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941f15e-a67b-4a99-a03b-02ecdd6dc13f service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.424033 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77988181-8bf0-4d16-b88d-bd56ba3c244e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.429289 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce97952-de40-47f5-8564-67b372b8c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.430467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce97952-de40-47f5-8564-67b372b8c235 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.430856 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce97952-de40-47f5-8564-67b372b8c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.431352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce97952-de40-47f5-8564-67b372b8c235 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.432377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce97952-de40-47f5-8564-67b372b8c235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.432847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941f15e-a67b-4a99-a03b-02ecdd6dc13f service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.434917 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce97952-de40-47f5-8564-67b372b8c235 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.438030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44fb05-5133-4fb3-a0c7-fc863092f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.439089 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44fb05-5133-4fb3-a0c7-fc863092f906 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.439328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44fb05-5133-4fb3-a0c7-fc863092f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.439541 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44fb05-5133-4fb3-a0c7-fc863092f906 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.440274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44fb05-5133-4fb3-a0c7-fc863092f906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.443511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44fb05-5133-4fb3-a0c7-fc863092f906 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.450475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1368/2710] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:22.450475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce97952-de40-47f5-8564-67b372b8c235 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.467514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce97952-de40-47f5-8564-67b372b8c235 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.472591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.477434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.477434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.477434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] PATH_INFO: `/v3/users/4544b9f6488a466084c0b8118bc7bf48` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.477434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4544b9f6488a466084c0b8118bc7bf48)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.477434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.530301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1343/2711] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:22 2022] POST /identity/v3/projects => generated 397 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:22.531220 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44fb05-5133-4fb3-a0c7-fc863092f906 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.591936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44fb05-5133-4fb3-a0c7-fc863092f906 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.597017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e21c-6fd1-489f-8564-8c6c67c6af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.597890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e21c-6fd1-489f-8564-8c6c67c6af74 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.598191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e21c-6fd1-489f-8564-8c6c67c6af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.598458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e21c-6fd1-489f-8564-8c6c67c6af74 admin admin] PATH_INFO: `/v3/projects/c8b3dbb962214af58e4c74ee584de789/users/4246335f82f44485afdeb438aafbef23/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.613110 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9e21c-6fd1-489f-8564-8c6c67c6af74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b3dbb962214af58e4c74ee584de789, user_id=4246335f82f44485afdeb438aafbef23, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.616489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9e21c-6fd1-489f-8564-8c6c67c6af74 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.630215 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:22.702533 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4544b9f6488a466084c0b8118bc7bf48'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:22.745207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1344/2712] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:22 2022] PUT /identity/v3/projects/c8b3dbb962214af58e4c74ee584de789/users/4246335f82f44485afdeb438aafbef23/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:22.746018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e21c-6fd1-489f-8564-8c6c67c6af74 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.766464 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4544b9f6488a466084c0b8118bc7bf48'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:22.774126 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4544b9f6488a466084c0b8118bc7bf48'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:22.797794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4544b9f6488a466084c0b8118bc7bf48'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:22.798534 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4544b9f6488a466084c0b8118bc7bf48'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:22.805451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1369/2713] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:22 2022] DELETE /identity/v3/users/4544b9f6488a466084c0b8118bc7bf48 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:22.806054 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:22.807365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:22.821225 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e21c-6fd1-489f-8564-8c6c67c6af74 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.871091 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa0e5f-23a6-406a-9117-0fc43fc979b2 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:22.876049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.876903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.877181 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.877331 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f2852-8170-4048-b443-02eda44dc2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:22.877460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] PATH_INFO: `/v3/projects/66627441872c4d03842fcdfead69ebfc` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.878030 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f2852-8170-4048-b443-02eda44dc2ed admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:22.878314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f2852-8170-4048-b443-02eda44dc2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:22.878615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66627441872c4d03842fcdfead69ebfc)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.878718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f2852-8170-4048-b443-02eda44dc2ed admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:22.879973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f2852-8170-4048-b443-02eda44dc2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:22.881198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:22.881885 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f2852-8170-4048-b443-02eda44dc2ed admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.000371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1345/2714] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:22 2022] POST /identity/v3/users => generated 299 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:23.000371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd22a0e-54f3-4ed4-a258-3bedd84b2bd1 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.000371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd22a0e-54f3-4ed4-a258-3bedd84b2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.000371 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd22a0e-54f3-4ed4-a258-3bedd84b2bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.026448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-1bd22a0e-54f3-4ed4-a258-3bedd84b2bd1 None None] MFA Rules not processed for user `4246335f82f44485afdeb438aafbef23`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:23.026664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66627441872c4d03842fcdfead69ebfc', 'request_id': 'req-3c65f4de-4d39-4a6d-8a04-a5f962c91118'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:23.027828 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1bd22a0e-54f3-4ed4-a258-3bedd84b2bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:23.032939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66627441872c4d03842fcdfead69ebfc', 'request_id': 'req-3c65f4de-4d39-4a6d-8a04-a5f962c91118'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:23.040034 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66627441872c4d03842fcdfead69ebfc', 'request_id': 'req-3c65f4de-4d39-4a6d-8a04-a5f962c91118'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:23.093636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1346/2715] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:23.094992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dae0f-60f4-45aa-9b19-48603758a920 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.095292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dae0f-60f4-45aa-9b19-48603758a920 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.095586 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dae0f-60f4-45aa-9b19-48603758a920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.114132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-ed5dae0f-60f4-45aa-9b19-48603758a920 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:23.115358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ed5dae0f-60f4-45aa-9b19-48603758a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:23.132506 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] The token cache is being invalidate because project 66627441872c4d03842fcdfead69ebfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:23.132796 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:23.133445 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:23.136706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1370/2716] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:22 2022] DELETE /identity/v3/projects/66627441872c4d03842fcdfead69ebfc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:23.136706 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.137224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:23.193891 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1347/2717] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:23.195690 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dae0f-60f4-45aa-9b19-48603758a920 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.197579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ed5dae0f-60f4-45aa-9b19-48603758a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:23.218210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dae0f-60f4-45aa-9b19-48603758a920 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.224297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b01c0-9fb4-40bd-a69d-8e320f0e154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.224994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b01c0-9fb4-40bd-a69d-8e320f0e154a admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.225281 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b01c0-9fb4-40bd-a69d-8e320f0e154a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.225559 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b01c0-9fb4-40bd-a69d-8e320f0e154a admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.226273 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b01c0-9fb4-40bd-a69d-8e320f0e154a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.228342 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b01c0-9fb4-40bd-a69d-8e320f0e154a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.248294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f4de-4d39-4a6d-8a04-a5f962c91118 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.253329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:23.256155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcf44f-a2cd-424c-9da7-7f99e5902229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.263067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcf44f-a2cd-424c-9da7-7f99e5902229 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.263067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcf44f-a2cd-424c-9da7-7f99e5902229 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.263067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcf44f-a2cd-424c-9da7-7f99e5902229 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.263067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcf44f-a2cd-424c-9da7-7f99e5902229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.263067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcf44f-a2cd-424c-9da7-7f99e5902229 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.271496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1371/2718] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:23.272287 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcf44f-a2cd-424c-9da7-7f99e5902229 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.274166 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-fcfcf44f-a2cd-424c-9da7-7f99e5902229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:23.339541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcf44f-a2cd-424c-9da7-7f99e5902229 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.344304 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61eb4f-32e9-49e8-a39b-50eb1df68e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.345077 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61eb4f-32e9-49e8-a39b-50eb1df68e4b service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.345460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61eb4f-32e9-49e8-a39b-50eb1df68e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.345847 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61eb4f-32e9-49e8-a39b-50eb1df68e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.356234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61eb4f-32e9-49e8-a39b-50eb1df68e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.357784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61eb4f-32e9-49e8-a39b-50eb1df68e4b service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.366297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1348/2719] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:23 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:23.366297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b01c0-9fb4-40bd-a69d-8e320f0e154a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.373262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1372/2720] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:23.374316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61eb4f-32e9-49e8-a39b-50eb1df68e4b service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.382665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:23.385889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61eb4f-32e9-49e8-a39b-50eb1df68e4b service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.449259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b01c0-9fb4-40bd-a69d-8e320f0e154a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.453708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b0cd6-0941-4599-8333-3c24ff83641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.454463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b0cd6-0941-4599-8333-3c24ff83641e admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.454820 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b0cd6-0941-4599-8333-3c24ff83641e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.454947 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281262-5154-4c41-b9ba-4b1dc270c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.455242 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b0cd6-0941-4599-8333-3c24ff83641e admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.456017 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281262-5154-4c41-b9ba-4b1dc270c995 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.461886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b0cd6-0941-4599-8333-3c24ff83641e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.462190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281262-5154-4c41-b9ba-4b1dc270c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.462190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281262-5154-4c41-b9ba-4b1dc270c995 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.462190 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281262-5154-4c41-b9ba-4b1dc270c995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.462452 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b0cd6-0941-4599-8333-3c24ff83641e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.462532 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281262-5154-4c41-b9ba-4b1dc270c995 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.472084 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1349/2721] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:23.477570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281262-5154-4c41-b9ba-4b1dc270c995 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.487460 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281262-5154-4c41-b9ba-4b1dc270c995 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.492759 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90519b99-1914-485f-bb14-3e381513ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.493633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90519b99-1914-485f-bb14-3e381513ed43 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.493919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90519b99-1914-485f-bb14-3e381513ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.494198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90519b99-1914-485f-bb14-3e381513ed43 admin admin] PATH_INFO: `/v3/projects/d035ad0266924f699b9aa6135b27d9b7/users/02d88cbe3ec6494bbe98b4eb8869b114/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.509742 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90519b99-1914-485f-bb14-3e381513ed43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d035ad0266924f699b9aa6135b27d9b7, user_id=02d88cbe3ec6494bbe98b4eb8869b114, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.512573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90519b99-1914-485f-bb14-3e381513ed43 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.543615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1373/2722] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:23 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:23.547925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b0cd6-0941-4599-8333-3c24ff83641e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.558770 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b0cd6-0941-4599-8333-3c24ff83641e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.563372 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c25d5-86ac-4a0c-9d7b-a544202f2548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.564066 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c25d5-86ac-4a0c-9d7b-a544202f2548 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.564355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c25d5-86ac-4a0c-9d7b-a544202f2548 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.564637 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c25d5-86ac-4a0c-9d7b-a544202f2548 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.565359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c25d5-86ac-4a0c-9d7b-a544202f2548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.567057 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c25d5-86ac-4a0c-9d7b-a544202f2548 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.577450 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1374/2723] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:23.581636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c25d5-86ac-4a0c-9d7b-a544202f2548 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.593794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c25d5-86ac-4a0c-9d7b-a544202f2548 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.599248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c84a25-9c50-49b3-8d16-7a380b11a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.600153 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c84a25-9c50-49b3-8d16-7a380b11a32e admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.600439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c84a25-9c50-49b3-8d16-7a380b11a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.600713 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c84a25-9c50-49b3-8d16-7a380b11a32e admin admin] PATH_INFO: `/v3/projects/e2345e59f2394396980fd5ceacaba35a/users/a721e50827ce43f99e29c0bcf95c199b/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.617607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c84a25-9c50-49b3-8d16-7a380b11a32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2345e59f2394396980fd5ceacaba35a, user_id=a721e50827ce43f99e29c0bcf95c199b, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.620346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c84a25-9c50-49b3-8d16-7a380b11a32e admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.624380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1350/2724] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:23 2022] PUT /identity/v3/projects/d035ad0266924f699b9aa6135b27d9b7/users/02d88cbe3ec6494bbe98b4eb8869b114/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:23.644152 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43851c91-e797-4dfd-9243-282526ba19f1 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.644519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43851c91-e797-4dfd-9243-282526ba19f1 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.644806 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43851c91-e797-4dfd-9243-282526ba19f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.672798 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-43851c91-e797-4dfd-9243-282526ba19f1 None None] MFA Rules not processed for user `02d88cbe3ec6494bbe98b4eb8869b114`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:23.677481 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-43851c91-e797-4dfd-9243-282526ba19f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:23.743458 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1351/2725] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:23.745527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1375/2726] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:23 2022] PUT /identity/v3/projects/e2345e59f2394396980fd5ceacaba35a/users/a721e50827ce43f99e29c0bcf95c199b/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:23.752666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43851c91-e797-4dfd-9243-282526ba19f1 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.758251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c84a25-9c50-49b3-8d16-7a380b11a32e admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.760331 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d8c84a25-9c50-49b3-8d16-7a380b11a32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:23.815078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43851c91-e797-4dfd-9243-282526ba19f1 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.817785 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c84a25-9c50-49b3-8d16-7a380b11a32e admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.821462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f52ca7-804b-495e-a01b-47d8a300405b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.822148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f52ca7-804b-495e-a01b-47d8a300405b service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.822429 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f52ca7-804b-495e-a01b-47d8a300405b service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.822701 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f52ca7-804b-495e-a01b-47d8a300405b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.882939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ae823-042d-43c0-8dce-4a7d411e9f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.882939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ae823-042d-43c0-8dce-4a7d411e9f80 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.882939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ae823-042d-43c0-8dce-4a7d411e9f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.882939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ae823-042d-43c0-8dce-4a7d411e9f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.883675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ae823-042d-43c0-8dce-4a7d411e9f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.883775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f52ca7-804b-495e-a01b-47d8a300405b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.883869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ae823-042d-43c0-8dce-4a7d411e9f80 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.883969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f52ca7-804b-495e-a01b-47d8a300405b service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.892480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1376/2727] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:23.894277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1352/2728] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:23.898935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ae823-042d-43c0-8dce-4a7d411e9f80 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.905211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f52ca7-804b-495e-a01b-47d8a300405b service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:23.906984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-79f52ca7-804b-495e-a01b-47d8a300405b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:23.910394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ae823-042d-43c0-8dce-4a7d411e9f80 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.915808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c11e9-aab2-4e79-a002-4dcb6ea79df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.916913 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c11e9-aab2-4e79-a002-4dcb6ea79df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.922520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c11e9-aab2-4e79-a002-4dcb6ea79df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.922520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c11e9-aab2-4e79-a002-4dcb6ea79df7 admin admin] PATH_INFO: `/v3/projects/e2345e59f2394396980fd5ceacaba35a/users/a721e50827ce43f99e29c0bcf95c199b/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.922520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c11e9-aab2-4e79-a002-4dcb6ea79df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2345e59f2394396980fd5ceacaba35a, user_id=a721e50827ce43f99e29c0bcf95c199b, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.922874 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f52ca7-804b-495e-a01b-47d8a300405b service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:23.922969 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c11e9-aab2-4e79-a002-4dcb6ea79df7 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.928994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:23.929944 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.930260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.930539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] PATH_INFO: `/v3/projects/cc22f342bfe84f1da1959001eec2148b` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.931794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc22f342bfe84f1da1959001eec2148b)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:23.933646 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1353/2729] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:23 2022] PUT /identity/v3/projects/e2345e59f2394396980fd5ceacaba35a/users/a721e50827ce43f99e29c0bcf95c199b/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:23.933865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:23.944091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae895b-f365-4391-936a-a3674bcab9af None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:23.944382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae895b-f365-4391-936a-a3674bcab9af None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:23.944662 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae895b-f365-4391-936a-a3674bcab9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:23.958058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:23.973655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-abae895b-f365-4391-936a-a3674bcab9af None None] MFA Rules not processed for user `a721e50827ce43f99e29c0bcf95c199b`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:23.974877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-abae895b-f365-4391-936a-a3674bcab9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:23.998106 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:24.049359 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1354/2730] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:24.060381 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae895b-f365-4391-936a-a3674bcab9af None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:24.085862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc22f342bfe84f1da1959001eec2148b', 'request_id': 'req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:24.095068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc22f342bfe84f1da1959001eec2148b', 'request_id': 'req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:24.102849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc22f342bfe84f1da1959001eec2148b', 'request_id': 'req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:24.120399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae895b-f365-4391-936a-a3674bcab9af None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:24.171510 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d04615-9aeb-40ef-b3d1-1c1a9b889f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:24.172431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d04615-9aeb-40ef-b3d1-1c1a9b889f13 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.172716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d04615-9aeb-40ef-b3d1-1c1a9b889f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.172992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d04615-9aeb-40ef-b3d1-1c1a9b889f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.206392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] The token cache is being invalidate because project cc22f342bfe84f1da1959001eec2148b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:24.206684 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:24.207357 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-36b8ffd8-d1f6-484c-b586-284b85bd9a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:24.209463 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1377/2731] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:23 2022] DELETE /identity/v3/projects/cc22f342bfe84f1da1959001eec2148b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:24.214577 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ab54-22d3-4257-a91f-b321d1700598 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.214988 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ab54-22d3-4257-a91f-b321d1700598 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.215332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6ab54-22d3-4257-a91f-b321d1700598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.234072 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-20c6ab54-22d3-4257-a91f-b321d1700598 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:24.235282 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-20c6ab54-22d3-4257-a91f-b321d1700598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:24.235425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d04615-9aeb-40ef-b3d1-1c1a9b889f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:24.236906 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d04615-9aeb-40ef-b3d1-1c1a9b889f13 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:24.246636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1355/2732] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:24.297156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1378/2733] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:24.306247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fd5b-2e33-4ded-8442-49684cf39c1b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.306536 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fd5b-2e33-4ded-8442-49684cf39c1b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.306856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fd5b-2e33-4ded-8442-49684cf39c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.325820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-0a41fd5b-2e33-4ded-8442-49684cf39c1b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:24.327011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-0a41fd5b-2e33-4ded-8442-49684cf39c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:24.335818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1356/2734] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:24.340071 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ab54-22d3-4257-a91f-b321d1700598 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:24.350302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6ab54-22d3-4257-a91f-b321d1700598 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:24.354983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f575a4-f423-42af-a0df-73d961a47575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:24.355661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f575a4-f423-42af-a0df-73d961a47575 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.355942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f575a4-f423-42af-a0df-73d961a47575 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.356211 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f575a4-f423-42af-a0df-73d961a47575 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.356943 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f575a4-f423-42af-a0df-73d961a47575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:24.357248 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f575a4-f423-42af-a0df-73d961a47575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:24.358865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f575a4-f423-42af-a0df-73d961a47575 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:24.373493 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1379/2735] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:24.378752 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fd5b-2e33-4ded-8442-49684cf39c1b None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:24.389241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fd5b-2e33-4ded-8442-49684cf39c1b None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:24.394410 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e464f9-db51-4694-b30e-53ad3a949c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:24.400171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e464f9-db51-4694-b30e-53ad3a949c12 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.400278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:24.400385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e464f9-db51-4694-b30e-53ad3a949c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.400385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e464f9-db51-4694-b30e-53ad3a949c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.400385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e464f9-db51-4694-b30e-53ad3a949c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:24.400385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e464f9-db51-4694-b30e-53ad3a949c12 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:24.511043 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1357/2736] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:24 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:24.512701 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f575a4-f423-42af-a0df-73d961a47575 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:24.520133 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e464f9-db51-4694-b30e-53ad3a949c12 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:24.522979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a1e464f9-db51-4694-b30e-53ad3a949c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:24.524353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f575a4-f423-42af-a0df-73d961a47575 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:24.555592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:24.583243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3d4d1-dc16-4888-8bc0-80a6e7d5ef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:24.584777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3d4d1-dc16-4888-8bc0-80a6e7d5ef03 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.585266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3d4d1-dc16-4888-8bc0-80a6e7d5ef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.585758 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3d4d1-dc16-4888-8bc0-80a6e7d5ef03 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.586954 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3d4d1-dc16-4888-8bc0-80a6e7d5ef03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:24.589290 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3d4d1-dc16-4888-8bc0-80a6e7d5ef03 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:24.596226 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e464f9-db51-4694-b30e-53ad3a949c12 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:24.600150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e2e74-c861-49e4-93cc-24a68354ec96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:24.600804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e2e74-c861-49e4-93cc-24a68354ec96 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.601096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e2e74-c861-49e4-93cc-24a68354ec96 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.601369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e2e74-c861-49e4-93cc-24a68354ec96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.603210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5f7e2e74-c861-49e4-93cc-24a68354ec96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:24.662679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e2e74-c861-49e4-93cc-24a68354ec96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:24.664163 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e2e74-c861-49e4-93cc-24a68354ec96 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:24.673419 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1358/2737] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:24.683975 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1380/2738] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:24 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:24.687846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e2e74-c861-49e4-93cc-24a68354ec96 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:24.702478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e2e74-c861-49e4-93cc-24a68354ec96 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:24.707314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea82e3-5d96-4118-ba9d-c478c637cfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:24.708008 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea82e3-5d96-4118-ba9d-c478c637cfab admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.708358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea82e3-5d96-4118-ba9d-c478c637cfab admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.714817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea82e3-5d96-4118-ba9d-c478c637cfab admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.714817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea82e3-5d96-4118-ba9d-c478c637cfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:24.714817 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea82e3-5d96-4118-ba9d-c478c637cfab admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:24.730766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1359/2739] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:24.730881 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3d4d1-dc16-4888-8bc0-80a6e7d5ef03 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:24.741477 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3d4d1-dc16-4888-8bc0-80a6e7d5ef03 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:24.746544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d7e11-5ad2-4484-a37f-f25089ca02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:24.747195 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d7e11-5ad2-4484-a37f-f25089ca02d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.747473 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d7e11-5ad2-4484-a37f-f25089ca02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.747838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d7e11-5ad2-4484-a37f-f25089ca02d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.748572 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d7e11-5ad2-4484-a37f-f25089ca02d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:24.750313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d7e11-5ad2-4484-a37f-f25089ca02d2 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:24.763622 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1381/2740] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:24.765852 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea82e3-5d96-4118-ba9d-c478c637cfab admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:24.776520 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea82e3-5d96-4118-ba9d-c478c637cfab admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:24.781302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d882-c3a9-4012-b172-58cad616af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:24.782187 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d882-c3a9-4012-b172-58cad616af03 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.782487 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d882-c3a9-4012-b172-58cad616af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.782749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d882-c3a9-4012-b172-58cad616af03 admin admin] PATH_INFO: `/v3/projects/9bcbfb7ab36e43cfa830f2914bcf215d/users/80c9ee48504a430183adf8ed4eff18c1/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:24.801719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847d882-c3a9-4012-b172-58cad616af03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bcbfb7ab36e43cfa830f2914bcf215d, user_id=80c9ee48504a430183adf8ed4eff18c1, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:24.804823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847d882-c3a9-4012-b172-58cad616af03 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:24.973325 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1360/2741] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:24 2022] PUT /identity/v3/projects/9bcbfb7ab36e43cfa830f2914bcf215d/users/80c9ee48504a430183adf8ed4eff18c1/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:24.983591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf196f-1ce3-4118-91dd-d363984fa093 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:24.984070 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf196f-1ce3-4118-91dd-d363984fa093 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:24.984381 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf196f-1ce3-4118-91dd-d363984fa093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:25.011303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-8bdf196f-1ce3-4118-91dd-d363984fa093 None None] MFA Rules not processed for user `80c9ee48504a430183adf8ed4eff18c1`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:25.012576 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8bdf196f-1ce3-4118-91dd-d363984fa093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:25.077462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1382/2742] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:25.089020 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d882-c3a9-4012-b172-58cad616af03 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:25.090708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f847d882-c3a9-4012-b172-58cad616af03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:25.218207 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:25.281029 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d882-c3a9-4012-b172-58cad616af03 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:25.285545 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d4d5-a604-4878-ac0d-727bb4ee96de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:25.286183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d4d5-a604-4878-ac0d-727bb4ee96de service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:25.287040 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d4d5-a604-4878-ac0d-727bb4ee96de service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:25.287315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d4d5-a604-4878-ac0d-727bb4ee96de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:25.300839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d4d5-a604-4878-ac0d-727bb4ee96de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:25.300839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d4d5-a604-4878-ac0d-727bb4ee96de service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:25.307825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1361/2743] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:25.494671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:26.305063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:26.406680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:26.943707 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:27.038030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:27.480544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:27.563266 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:27.991641 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:28.249288 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:28.337978 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:28.471350 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf196f-1ce3-4118-91dd-d363984fa093 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:28.533955 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf196f-1ce3-4118-91dd-d363984fa093 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:28.539144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:28.540076 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:28.545140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:28.545140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] PATH_INFO: `/v3/users/80c9ee48504a430183adf8ed4eff18c1` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:28.545140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c9ee48504a430183adf8ed4eff18c1)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:28.545140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:28.769023 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c9ee48504a430183adf8ed4eff18c1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:28.860121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c9ee48504a430183adf8ed4eff18c1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:28.869555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c9ee48504a430183adf8ed4eff18c1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:28.882169 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c9ee48504a430183adf8ed4eff18c1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:28.882919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c9ee48504a430183adf8ed4eff18c1'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:28.889274 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1383/2744] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:28 2022] DELETE /identity/v3/users/80c9ee48504a430183adf8ed4eff18c1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:28.894026 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e43b4-8108-4531-a5ab-95082cb26f81 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:28.894549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e43b4-8108-4531-a5ab-95082cb26f81 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:28.894659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e43b4-8108-4531-a5ab-95082cb26f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:28.912096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-610e43b4-8108-4531-a5ab-95082cb26f81 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:28.913856 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-610e43b4-8108-4531-a5ab-95082cb26f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:28.979554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1362/2745] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:28.989421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:28.991554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:29.032989 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:29.050252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bb8b0-37a9-4dc4-ad6c-d0720e0219cc admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:29.053787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c82417-926a-430a-bd10-087c31036924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:29.054421 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c82417-926a-430a-bd10-087c31036924 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:29.054700 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c82417-926a-430a-bd10-087c31036924 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:29.054970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c82417-926a-430a-bd10-087c31036924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:29.067792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c82417-926a-430a-bd10-087c31036924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:29.069286 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c82417-926a-430a-bd10-087c31036924 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:29.079392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1384/2746] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:29.314916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:29.584087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:29.810888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e43b4-8108-4531-a5ab-95082cb26f81 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:29.812518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-610e43b4-8108-4531-a5ab-95082cb26f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:29.829786 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e43b4-8108-4531-a5ab-95082cb26f81 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:29.834570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:29.835609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:29.835809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:29.836082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] PATH_INFO: `/v3/projects/9bcbfb7ab36e43cfa830f2914bcf215d` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:29.837495 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bcbfb7ab36e43cfa830f2914bcf215d)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:29.839393 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:29.842531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:30.089616 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bcbfb7ab36e43cfa830f2914bcf215d', 'request_id': 'req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.096093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bcbfb7ab36e43cfa830f2914bcf215d', 'request_id': 'req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.102086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bcbfb7ab36e43cfa830f2914bcf215d', 'request_id': 'req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.178724 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c82417-926a-430a-bd10-087c31036924 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:30.180191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d2c82417-926a-430a-bd10-087c31036924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:30.192967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c82417-926a-430a-bd10-087c31036924 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:30.208309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] The token cache is being invalidate because project 9bcbfb7ab36e43cfa830f2914bcf215d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:30.208633 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.209285 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-8e80171d-45b6-43e8-9ba1-14f65db7a5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.211382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1363/2747] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:29 2022] DELETE /identity/v3/projects/9bcbfb7ab36e43cfa830f2914bcf215d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:30.216530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdaa30-2306-4266-ba70-d3299003d59b None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.216836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdaa30-2306-4266-ba70-d3299003d59b None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.217378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdaa30-2306-4266-ba70-d3299003d59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.235887 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8fbdaa30-2306-4266-ba70-d3299003d59b None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:30.237087 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8fbdaa30-2306-4266-ba70-d3299003d59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:30.252058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:30.253148 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.253437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.253694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] PATH_INFO: `/v3/users/02d88cbe3ec6494bbe98b4eb8869b114` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.254912 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d88cbe3ec6494bbe98b4eb8869b114)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:30.257364 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:30.303074 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1364/2748] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:30.311600 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e61fc-002a-4c9b-af27-9e975ef81c9e None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.311892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e61fc-002a-4c9b-af27-9e975ef81c9e None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.312188 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e61fc-002a-4c9b-af27-9e975ef81c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.330780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a43e61fc-002a-4c9b-af27-9e975ef81c9e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:30.331991 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a43e61fc-002a-4c9b-af27-9e975ef81c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:30.340390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1365/2749] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:12:30.344767 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e61fc-002a-4c9b-af27-9e975ef81c9e None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:30.355631 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e61fc-002a-4c9b-af27-9e975ef81c9e None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:30.359994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63329a55-5602-45f5-b5a1-e5cb88cfcd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:30.360648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63329a55-5602-45f5-b5a1-e5cb88cfcd4b admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.360932 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63329a55-5602-45f5-b5a1-e5cb88cfcd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.361267 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63329a55-5602-45f5-b5a1-e5cb88cfcd4b admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.361994 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63329a55-5602-45f5-b5a1-e5cb88cfcd4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:30.362301 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63329a55-5602-45f5-b5a1-e5cb88cfcd4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:30.363933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63329a55-5602-45f5-b5a1-e5cb88cfcd4b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:30.376550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1366/2750] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:12:30.380933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63329a55-5602-45f5-b5a1-e5cb88cfcd4b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:30.390569 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63329a55-5602-45f5-b5a1-e5cb88cfcd4b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:30.395104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6ca14-29a5-4aca-9652-706811723802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:30.395797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6ca14-29a5-4aca-9652-706811723802 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.396082 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6ca14-29a5-4aca-9652-706811723802 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.396364 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6ca14-29a5-4aca-9652-706811723802 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.397070 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6ca14-29a5-4aca-9652-706811723802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:30.398946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6ca14-29a5-4aca-9652-706811723802 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:30.523027 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1367/2751] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:30 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:30.523889 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6ca14-29a5-4aca-9652-706811723802 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:30.528377 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d88cbe3ec6494bbe98b4eb8869b114'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.574980 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:30.586988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6ca14-29a5-4aca-9652-706811723802 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:30.594124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df51a11-e2f9-4997-92cb-3948295dd57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:30.596665 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df51a11-e2f9-4997-92cb-3948295dd57a admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.597101 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df51a11-e2f9-4997-92cb-3948295dd57a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.597426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df51a11-e2f9-4997-92cb-3948295dd57a admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.598246 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df51a11-e2f9-4997-92cb-3948295dd57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:30.600933 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df51a11-e2f9-4997-92cb-3948295dd57a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:30.617470 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d88cbe3ec6494bbe98b4eb8869b114'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.625476 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d88cbe3ec6494bbe98b4eb8869b114'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.638359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d88cbe3ec6494bbe98b4eb8869b114'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.639781 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e563cfd0-4b1d-4946-b744-5d70bc3f59a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d88cbe3ec6494bbe98b4eb8869b114'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:30.645967 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1385/2752] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:30 2022] DELETE /identity/v3/users/02d88cbe3ec6494bbe98b4eb8869b114 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:30.651285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997c263-464e-456e-a20d-24c31358d28d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.651654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997c263-464e-456e-a20d-24c31358d28d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.651931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997c263-464e-456e-a20d-24c31358d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.669531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1997c263-464e-456e-a20d-24c31358d28d None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:30.670743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1997c263-464e-456e-a20d-24c31358d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:30.692137 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:30.733387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1386/2753] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:30.734823 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1368/2754] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:30 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:30.740318 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997c263-464e-456e-a20d-24c31358d28d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:30.742294 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1997c263-464e-456e-a20d-24c31358d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:30.744046 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df51a11-e2f9-4997-92cb-3948295dd57a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:30.746001 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1df51a11-e2f9-4997-92cb-3948295dd57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:30.755513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997c263-464e-456e-a20d-24c31358d28d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:30.761143 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f181a-5aca-4650-8503-e344fffc603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:30.765384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f181a-5aca-4650-8503-e344fffc603c admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.765384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f181a-5aca-4650-8503-e344fffc603c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.765384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f181a-5aca-4650-8503-e344fffc603c admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.765384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f181a-5aca-4650-8503-e344fffc603c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:30.765384 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f181a-5aca-4650-8503-e344fffc603c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:30.775697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1387/2755] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:30.779730 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f181a-5aca-4650-8503-e344fffc603c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:30.790326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f181a-5aca-4650-8503-e344fffc603c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:30.795340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845c0e-0e85-492b-982d-eaf20456273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:30.796028 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845c0e-0e85-492b-982d-eaf20456273a admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.796317 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845c0e-0e85-492b-982d-eaf20456273a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.796594 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845c0e-0e85-492b-982d-eaf20456273a admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.797312 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9845c0e-0e85-492b-982d-eaf20456273a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:30.798919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9845c0e-0e85-492b-982d-eaf20456273a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:30.809725 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1388/2756] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:30.813842 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845c0e-0e85-492b-982d-eaf20456273a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:30.814507 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df51a11-e2f9-4997-92cb-3948295dd57a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:30.824494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845c0e-0e85-492b-982d-eaf20456273a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:30.829784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b886d-f2c2-4892-90f2-9306b9bfaab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:30.830565 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b886d-f2c2-4892-90f2-9306b9bfaab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.833175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b886d-f2c2-4892-90f2-9306b9bfaab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.833175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b886d-f2c2-4892-90f2-9306b9bfaab8 admin admin] PATH_INFO: `/v3/projects/bd0266c35d454cb9a7fc8568babd43e0/users/4d034de215164ccd8419fb7a9a8b294a/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.846673 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b886d-f2c2-4892-90f2-9306b9bfaab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0266c35d454cb9a7fc8568babd43e0, user_id=4d034de215164ccd8419fb7a9a8b294a, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:30.849437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b886d-f2c2-4892-90f2-9306b9bfaab8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:30.874441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957df35e-21e8-4334-bb1d-ec7a0abe2210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:30.875732 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df35e-21e8-4334-bb1d-ec7a0abe2210 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.875732 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df35e-21e8-4334-bb1d-ec7a0abe2210 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.875928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df35e-21e8-4334-bb1d-ec7a0abe2210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:30.887733 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957df35e-21e8-4334-bb1d-ec7a0abe2210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:30.889100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957df35e-21e8-4334-bb1d-ec7a0abe2210 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:30.904759 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1369/2757] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:12:30.966776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1389/2758] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:30 2022] PUT /identity/v3/projects/bd0266c35d454cb9a7fc8568babd43e0/users/4d034de215164ccd8419fb7a9a8b294a/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:30.978926 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2ba8-57b2-46f6-8cf9-31436cc2ac66 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:30.979225 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2ba8-57b2-46f6-8cf9-31436cc2ac66 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:30.979553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2ba8-57b2-46f6-8cf9-31436cc2ac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:31.019049 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-68be2ba8-57b2-46f6-8cf9-31436cc2ac66 None None] MFA Rules not processed for user `4d034de215164ccd8419fb7a9a8b294a`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:31.020307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-68be2ba8-57b2-46f6-8cf9-31436cc2ac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:31.087549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1370/2759] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:31.099017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b886d-f2c2-4892-90f2-9306b9bfaab8 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:31.101198 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-714b886d-f2c2-4892-90f2-9306b9bfaab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:31.158336 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b886d-f2c2-4892-90f2-9306b9bfaab8 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:31.162089 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469f51d-ea00-4686-b140-389f608f717b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:31.163275 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f51d-ea00-4686-b140-389f608f717b service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:31.163551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f51d-ea00-4686-b140-389f608f717b service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:31.163849 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f51d-ea00-4686-b140-389f608f717b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:31.172017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469f51d-ea00-4686-b140-389f608f717b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:31.173484 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469f51d-ea00-4686-b140-389f608f717b service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:31.183223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1390/2760] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:31.508847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be2ba8-57b2-46f6-8cf9-31436cc2ac66 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:31.510072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-68be2ba8-57b2-46f6-8cf9-31436cc2ac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:31.545387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:31.582820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be2ba8-57b2-46f6-8cf9-31436cc2ac66 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:31.587819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:31.588745 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:31.589031 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:31.589307 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] PATH_INFO: `/v3/projects/d035ad0266924f699b9aa6135b27d9b7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:31.590549 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d035ad0266924f699b9aa6135b27d9b7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:31.592850 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:31.725680 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd035ad0266924f699b9aa6135b27d9b7', 'request_id': 'req-1e40b8ff-c5f0-4320-976c-3253461c6fc3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:31.736650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd035ad0266924f699b9aa6135b27d9b7', 'request_id': 'req-1e40b8ff-c5f0-4320-976c-3253461c6fc3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:31.743534 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd035ad0266924f699b9aa6135b27d9b7', 'request_id': 'req-1e40b8ff-c5f0-4320-976c-3253461c6fc3'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:31.836825 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] The token cache is being invalidate because project d035ad0266924f699b9aa6135b27d9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:31.837093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:31.837787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1e40b8ff-c5f0-4320-976c-3253461c6fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:31.839335 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1371/2761] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:31 2022] DELETE /identity/v3/projects/d035ad0266924f699b9aa6135b27d9b7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:34.882838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469f51d-ea00-4686-b140-389f608f717b service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:34.884284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8469f51d-ea00-4686-b140-389f608f717b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:34.898839 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469f51d-ea00-4686-b140-389f608f717b service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:34.955913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:34.956782 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:34.957064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:34.957339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] PATH_INFO: `/v3/users/4246335f82f44485afdeb438aafbef23` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:34.958537 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4246335f82f44485afdeb438aafbef23)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:34.960518 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:35.209527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:35.346109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4246335f82f44485afdeb438aafbef23'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.562174 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4246335f82f44485afdeb438aafbef23'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.570438 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4246335f82f44485afdeb438aafbef23'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.582584 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4246335f82f44485afdeb438aafbef23'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.583319 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4246335f82f44485afdeb438aafbef23'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:35.590051 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1391/2762] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:34 2022] DELETE /identity/v3/users/4246335f82f44485afdeb438aafbef23 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:35.595391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20c945-74ca-473a-b0d3-c98c51185331 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:35.598184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20c945-74ca-473a-b0d3-c98c51185331 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:35.598184 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20c945-74ca-473a-b0d3-c98c51185331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:35.613772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-9f20c945-74ca-473a-b0d3-c98c51185331 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:35.614973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9f20c945-74ca-473a-b0d3-c98c51185331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:35.674194 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1372/2763] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:35.684738 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:35.692081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:35.753544 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b19ea1-3902-45ea-8bd7-1c57613fc087 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:35.757410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af2989-650c-42fe-8407-b463f15bd067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:35.758058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af2989-650c-42fe-8407-b463f15bd067 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:35.758342 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af2989-650c-42fe-8407-b463f15bd067 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:35.758625 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af2989-650c-42fe-8407-b463f15bd067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:35.767781 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af2989-650c-42fe-8407-b463f15bd067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:35.769209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af2989-650c-42fe-8407-b463f15bd067 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:35.779175 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1392/2764] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:36.312897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20c945-74ca-473a-b0d3-c98c51185331 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:36.314399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9f20c945-74ca-473a-b0d3-c98c51185331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:36.326305 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20c945-74ca-473a-b0d3-c98c51185331 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:36.331216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:36.332435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:36.332435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:36.332689 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] PATH_INFO: `/v3/projects/c8b3dbb962214af58e4c74ee584de789` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:36.333884 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b3dbb962214af58e4c74ee584de789)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:36.336988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:36.500956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b3dbb962214af58e4c74ee584de789', 'request_id': 'req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.507107 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b3dbb962214af58e4c74ee584de789', 'request_id': 'req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.508333 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:36.513039 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b3dbb962214af58e4c74ee584de789', 'request_id': 'req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.591232 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] The token cache is being invalidate because project c8b3dbb962214af58e4c74ee584de789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:36.591518 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.592514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.594385 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1373/2765] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:36 2022] DELETE /identity/v3/projects/c8b3dbb962214af58e4c74ee584de789 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:36.598554 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af2989-650c-42fe-8407-b463f15bd067 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:36.609753 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af2989-650c-42fe-8407-b463f15bd067 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:36.666440 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:36.667302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:36.667599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:36.667875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] PATH_INFO: `/v3/users/a721e50827ce43f99e29c0bcf95c199b` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:36.669052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a721e50827ce43f99e29c0bcf95c199b)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:36.670983 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:36.877419 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a721e50827ce43f99e29c0bcf95c199b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:36.879158 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:37.086017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a721e50827ce43f99e29c0bcf95c199b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.094664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a721e50827ce43f99e29c0bcf95c199b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.107871 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a721e50827ce43f99e29c0bcf95c199b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.108353 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9257f34f-c5cb-436b-b05a-ff66e4aa4e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a721e50827ce43f99e29c0bcf95c199b'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.114676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1393/2766] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:36 2022] DELETE /identity/v3/users/a721e50827ce43f99e29c0bcf95c199b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:37.670639 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:37.677500 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:37.692150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d640d-38a2-451c-bc4d-8f3fe4afc15b admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:37.749647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:37.750544 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:37.750802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:37.751072 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] PATH_INFO: `/v3/projects/e2345e59f2394396980fd5ceacaba35a` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:37.752249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2345e59f2394396980fd5ceacaba35a)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:37.754158 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:37.891636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2345e59f2394396980fd5ceacaba35a', 'request_id': 'req-76358eb6-d95e-46a6-8b10-767e90e467e7'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.897927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2345e59f2394396980fd5ceacaba35a', 'request_id': 'req-76358eb6-d95e-46a6-8b10-767e90e467e7'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:37.903478 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2345e59f2394396980fd5ceacaba35a', 'request_id': 'req-76358eb6-d95e-46a6-8b10-767e90e467e7'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.040506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] The token cache is being invalidate because project e2345e59f2394396980fd5ceacaba35a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:38.040789 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.041427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-76358eb6-d95e-46a6-8b10-767e90e467e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:38.042942 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1374/2767] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:37 2022] DELETE /identity/v3/projects/e2345e59f2394396980fd5ceacaba35a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:38.047870 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed2d79-07a8-40fd-ade4-4305a3c65130 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.048717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed2d79-07a8-40fd-ade4-4305a3c65130 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.048717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed2d79-07a8-40fd-ade4-4305a3c65130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.066689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-80ed2d79-07a8-40fd-ade4-4305a3c65130 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:38.067968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-80ed2d79-07a8-40fd-ade4-4305a3c65130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:38.128761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1394/2768] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:38.136527 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0182f-cbcc-4be2-bf19-a47e589af334 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.136819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0182f-cbcc-4be2-bf19-a47e589af334 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.137102 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0182f-cbcc-4be2-bf19-a47e589af334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.156251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-a4a0182f-cbcc-4be2-bf19-a47e589af334 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:38.157560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a4a0182f-cbcc-4be2-bf19-a47e589af334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:38.166576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1375/2769] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:38.170766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed2d79-07a8-40fd-ade4-4305a3c65130 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.181185 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed2d79-07a8-40fd-ade4-4305a3c65130 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.185705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089e87e-226a-460d-a532-3a05678babdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.186369 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089e87e-226a-460d-a532-3a05678babdc admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.186650 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089e87e-226a-460d-a532-3a05678babdc admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.186931 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089e87e-226a-460d-a532-3a05678babdc admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.187672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089e87e-226a-460d-a532-3a05678babdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:38.187982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089e87e-226a-460d-a532-3a05678babdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.189613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089e87e-226a-460d-a532-3a05678babdc admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.206434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1395/2770] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:38.206822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0182f-cbcc-4be2-bf19-a47e589af334 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.220686 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0182f-cbcc-4be2-bf19-a47e589af334 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.223378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456fbc1-81ed-4f2f-900d-512bebf9b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.224154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456fbc1-81ed-4f2f-900d-512bebf9b3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.224441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456fbc1-81ed-4f2f-900d-512bebf9b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.224717 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456fbc1-81ed-4f2f-900d-512bebf9b3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.225990 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456fbc1-81ed-4f2f-900d-512bebf9b3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.227973 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456fbc1-81ed-4f2f-900d-512bebf9b3b1 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.314098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1376/2771] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:38 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:38.318773 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089e87e-226a-460d-a532-3a05678babdc admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.331508 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089e87e-226a-460d-a532-3a05678babdc admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.391595 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56c9ee-b028-4c5f-8359-30d32fb74829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.392368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56c9ee-b028-4c5f-8359-30d32fb74829 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.392654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56c9ee-b028-4c5f-8359-30d32fb74829 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.392962 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56c9ee-b028-4c5f-8359-30d32fb74829 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.393665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56c9ee-b028-4c5f-8359-30d32fb74829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.395716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56c9ee-b028-4c5f-8359-30d32fb74829 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.530455 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1396/2772] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:38 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:38.531587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456fbc1-81ed-4f2f-900d-512bebf9b3b1 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.542678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456fbc1-81ed-4f2f-900d-512bebf9b3b1 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.547438 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eb010-c043-401f-ac47-7f9bb7286216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.548134 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eb010-c043-401f-ac47-7f9bb7286216 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.548414 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eb010-c043-401f-ac47-7f9bb7286216 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.551864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eb010-c043-401f-ac47-7f9bb7286216 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.551864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9eb010-c043-401f-ac47-7f9bb7286216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.551864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9eb010-c043-401f-ac47-7f9bb7286216 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.562418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1377/2773] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:38.566663 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56c9ee-b028-4c5f-8359-30d32fb74829 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.577046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56c9ee-b028-4c5f-8359-30d32fb74829 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.581722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3cc3-086b-486f-8b06-6e6fcd608a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.586757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3cc3-086b-486f-8b06-6e6fcd608a4b admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.586757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3cc3-086b-486f-8b06-6e6fcd608a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.586757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3cc3-086b-486f-8b06-6e6fcd608a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.586757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3cc3-086b-486f-8b06-6e6fcd608a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.586757 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3cc3-086b-486f-8b06-6e6fcd608a4b admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.598068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1397/2774] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:38.602691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eb010-c043-401f-ac47-7f9bb7286216 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.613378 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eb010-c043-401f-ac47-7f9bb7286216 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.618820 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b554228-6108-49e1-8f2f-e46fb4a0b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.619724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b554228-6108-49e1-8f2f-e46fb4a0b622 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.620002 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b554228-6108-49e1-8f2f-e46fb4a0b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.620272 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b554228-6108-49e1-8f2f-e46fb4a0b622 admin admin] PATH_INFO: `/v3/projects/153b1d2574c54a29836d88f7e85c865d/users/4ed25948d5c04f039c49fb34d73acc8c/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.636449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b554228-6108-49e1-8f2f-e46fb4a0b622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153b1d2574c54a29836d88f7e85c865d, user_id=4ed25948d5c04f039c49fb34d73acc8c, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.639239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b554228-6108-49e1-8f2f-e46fb4a0b622 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:38.783627 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1378/2775] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:38 2022] PUT /identity/v3/projects/153b1d2574c54a29836d88f7e85c865d/users/4ed25948d5c04f039c49fb34d73acc8c/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:38.794919 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1a35-e1bc-4e8e-a20d-de7765748ed1 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.795413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1a35-e1bc-4e8e-a20d-de7765748ed1 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.795794 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1a35-e1bc-4e8e-a20d-de7765748ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.827752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d76b1a35-e1bc-4e8e-a20d-de7765748ed1 None None] MFA Rules not processed for user `4ed25948d5c04f039c49fb34d73acc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:38.828947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d76b1a35-e1bc-4e8e-a20d-de7765748ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:38.849003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:38.896034 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1398/2776] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:38.901094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b554228-6108-49e1-8f2f-e46fb4a0b622 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:38.912003 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:38.965209 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b554228-6108-49e1-8f2f-e46fb4a0b622 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:38.970175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd864e5-e948-4f49-bee9-d389731beaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:38.970827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd864e5-e948-4f49-bee9-d389731beaaa admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:38.971108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd864e5-e948-4f49-bee9-d389731beaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:38.971382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd864e5-e948-4f49-bee9-d389731beaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:38.972109 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd864e5-e948-4f49-bee9-d389731beaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:38.974007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd864e5-e948-4f49-bee9-d389731beaaa admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.061585 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1379/2777] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:38 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:39.065933 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1a35-e1bc-4e8e-a20d-de7765748ed1 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.076890 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1a35-e1bc-4e8e-a20d-de7765748ed1 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.133766 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4d12d-1fff-42ad-aea4-3a9d263fbb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.134428 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4d12d-1fff-42ad-aea4-3a9d263fbb81 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.134709 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4d12d-1fff-42ad-aea4-3a9d263fbb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.135460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4d12d-1fff-42ad-aea4-3a9d263fbb81 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.136228 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4d12d-1fff-42ad-aea4-3a9d263fbb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.138596 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4d12d-1fff-42ad-aea4-3a9d263fbb81 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.243368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1399/2778] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:39 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:12:39.247673 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd864e5-e948-4f49-bee9-d389731beaaa admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.257805 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd864e5-e948-4f49-bee9-d389731beaaa admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.262629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf23b1-b2cd-45a3-a856-65a41601c654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.263297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf23b1-b2cd-45a3-a856-65a41601c654 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.263812 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf23b1-b2cd-45a3-a856-65a41601c654 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.264449 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf23b1-b2cd-45a3-a856-65a41601c654 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.265256 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf23b1-b2cd-45a3-a856-65a41601c654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.266841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf23b1-b2cd-45a3-a856-65a41601c654 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.277142 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1380/2779] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:39.283395 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4d12d-1fff-42ad-aea4-3a9d263fbb81 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.294046 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4d12d-1fff-42ad-aea4-3a9d263fbb81 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.299064 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78696dc2-d242-455a-88a3-98d6c528572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.300115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78696dc2-d242-455a-88a3-98d6c528572f admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.300410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78696dc2-d242-455a-88a3-98d6c528572f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.300676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78696dc2-d242-455a-88a3-98d6c528572f admin admin] PATH_INFO: `/v3/projects/5b270ec9641c4140bef53f521a611cc9/users/11b694ecae954578a4c925f9247075f2/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.317881 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78696dc2-d242-455a-88a3-98d6c528572f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b270ec9641c4140bef53f521a611cc9, user_id=11b694ecae954578a4c925f9247075f2, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.320585 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78696dc2-d242-455a-88a3-98d6c528572f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.395122 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1400/2780] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:39 2022] PUT /identity/v3/projects/5b270ec9641c4140bef53f521a611cc9/users/11b694ecae954578a4c925f9247075f2/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:12:39.399203 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf23b1-b2cd-45a3-a856-65a41601c654 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.409609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf23b1-b2cd-45a3-a856-65a41601c654 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.464822 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4a465-1db0-4f4c-a7ce-6db474bf4785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.465489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a465-1db0-4f4c-a7ce-6db474bf4785 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.465774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a465-1db0-4f4c-a7ce-6db474bf4785 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.466048 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a465-1db0-4f4c-a7ce-6db474bf4785 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.466769 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4a465-1db0-4f4c-a7ce-6db474bf4785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.468663 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4a465-1db0-4f4c-a7ce-6db474bf4785 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.478607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1381/2781] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:39.483315 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78696dc2-d242-455a-88a3-98d6c528572f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.494325 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78696dc2-d242-455a-88a3-98d6c528572f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.499212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab85669-edf3-44ac-babd-83b8fdb7c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.499898 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85669-edf3-44ac-babd-83b8fdb7c88a admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.500178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85669-edf3-44ac-babd-83b8fdb7c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.500453 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85669-edf3-44ac-babd-83b8fdb7c88a admin admin] PATH_INFO: `/v3/projects/5b270ec9641c4140bef53f521a611cc9/users/11b694ecae954578a4c925f9247075f2/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.502489 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab85669-edf3-44ac-babd-83b8fdb7c88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b270ec9641c4140bef53f521a611cc9, user_id=11b694ecae954578a4c925f9247075f2, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.505229 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab85669-edf3-44ac-babd-83b8fdb7c88a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.516159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1401/2782] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:39 2022] PUT /identity/v3/projects/5b270ec9641c4140bef53f521a611cc9/users/11b694ecae954578a4c925f9247075f2/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:39.527341 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad3d91-551f-47d2-88fb-96c34e84527d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.527925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad3d91-551f-47d2-88fb-96c34e84527d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.527925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad3d91-551f-47d2-88fb-96c34e84527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.554471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-68ad3d91-551f-47d2-88fb-96c34e84527d None None] MFA Rules not processed for user `11b694ecae954578a4c925f9247075f2`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:39.562093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-68ad3d91-551f-47d2-88fb-96c34e84527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:39.622669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1382/2783] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:39.638979 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab85669-edf3-44ac-babd-83b8fdb7c88a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:39.640568 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-dab85669-edf3-44ac-babd-83b8fdb7c88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:39.700708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab85669-edf3-44ac-babd-83b8fdb7c88a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:39.704590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210dfcc-b7c9-46bc-82f6-d57cb779f66f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:39.705234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210dfcc-b7c9-46bc-82f6-d57cb779f66f service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:39.705526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210dfcc-b7c9-46bc-82f6-d57cb779f66f service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:39.705832 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210dfcc-b7c9-46bc-82f6-d57cb779f66f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:39.715284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210dfcc-b7c9-46bc-82f6-d57cb779f66f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:39.716791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210dfcc-b7c9-46bc-82f6-d57cb779f66f service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:39.726548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1402/2784] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:40.817953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad3d91-551f-47d2-88fb-96c34e84527d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:40.824099 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:40.827941 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad3d91-551f-47d2-88fb-96c34e84527d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:40.832506 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266b95e-e46a-409e-9d38-8b198eae526f tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b694ecae954578a4c925f9247075f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b270ec9641c4140bef53f521a611cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:40.833177 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b95e-e46a-409e-9d38-8b198eae526f tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.833470 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b95e-e46a-409e-9d38-8b198eae526f tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.833747 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b95e-e46a-409e-9d38-8b198eae526f tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.835207 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266b95e-e46a-409e-9d38-8b198eae526f tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:40.835546 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266b95e-e46a-409e-9d38-8b198eae526f tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:40.837138 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266b95e-e46a-409e-9d38-8b198eae526f tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:40.848864 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1383/2785] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:40.853115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210dfcc-b7c9-46bc-82f6-d57cb779f66f service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:40.862458 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210dfcc-b7c9-46bc-82f6-d57cb779f66f service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:40.867118 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29b8e2-05cc-4b70-a054-4c1d977ad806 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b694ecae954578a4c925f9247075f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b270ec9641c4140bef53f521a611cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:40.867821 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29b8e2-05cc-4b70-a054-4c1d977ad806 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:40.868094 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29b8e2-05cc-4b70-a054-4c1d977ad806 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:40.868371 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29b8e2-05cc-4b70-a054-4c1d977ad806 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:40.869063 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29b8e2-05cc-4b70-a054-4c1d977ad806 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:40.870993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29b8e2-05cc-4b70-a054-4c1d977ad806 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:40.885225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:41.001285 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1403/2786] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:40 2022] POST /identity/v3/projects => generated 355 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:41.005572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266b95e-e46a-409e-9d38-8b198eae526f tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:41.015390 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266b95e-e46a-409e-9d38-8b198eae526f tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:41.072919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b694ecae954578a4c925f9247075f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b270ec9641c4140bef53f521a611cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:41.073504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.073800 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.074080 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.075005 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:41.075345 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:41.077044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:41.089144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1384/2787] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:12:41.126271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29b8e2-05cc-4b70-a054-4c1d977ad806 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:41.136578 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29b8e2-05cc-4b70-a054-4c1d977ad806 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:41.141323 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b694ecae954578a4c925f9247075f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b270ec9641c4140bef53f521a611cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:41.142178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:41.142465 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:41.142740 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] PATH_INFO: `/v3/projects/4a9ec9f63e9143fab1e4af9254afcff3` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:41.143940 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a9ec9f63e9143fab1e4af9254afcff3)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:41.145846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:41.259878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9ec9f63e9143fab1e4af9254afcff3', 'request_id': 'req-80c87ab1-0cf1-4f29-84de-d030a37f35fc'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:41.265969 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9ec9f63e9143fab1e4af9254afcff3', 'request_id': 'req-80c87ab1-0cf1-4f29-84de-d030a37f35fc'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:41.272164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9ec9f63e9143fab1e4af9254afcff3', 'request_id': 'req-80c87ab1-0cf1-4f29-84de-d030a37f35fc'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:41.390500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] The token cache is being invalidate because project 4a9ec9f63e9143fab1e4af9254afcff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:41.390792 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:41.391417 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-80c87ab1-0cf1-4f29-84de-d030a37f35fc tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:41.393109 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1404/2788] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:41 2022] DELETE /identity/v3/projects/4a9ec9f63e9143fab1e4af9254afcff3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:42.087192 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:42.089049 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:42.159092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad0a7-dff5-4b31-9296-6e8676d81d01 tempest-VolumeQuotaClassesTest-1637590966 tempest-VolumeQuotaClassesTest-1637590966-project-admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:42.216306 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:42.217457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:42.217730 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:42.217997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] PATH_INFO: `/v3/users/4ed25948d5c04f039c49fb34d73acc8c` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:42.219171 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed25948d5c04f039c49fb34d73acc8c)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:42.221151 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:42.422399 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:42.431486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed25948d5c04f039c49fb34d73acc8c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:42.438329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed25948d5c04f039c49fb34d73acc8c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:42.438995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed25948d5c04f039c49fb34d73acc8c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:42.451962 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed25948d5c04f039c49fb34d73acc8c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:42.452610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed25948d5c04f039c49fb34d73acc8c'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:42.523135 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1385/2789] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:42 2022] DELETE /identity/v3/users/4ed25948d5c04f039c49fb34d73acc8c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:42.528356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0be7c-b8fd-42b5-849f-ad6e304f7a85 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:42.528879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0be7c-b8fd-42b5-849f-ad6e304f7a85 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:42.528991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0be7c-b8fd-42b5-849f-ad6e304f7a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:42.546838 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-65a0be7c-b8fd-42b5-849f-ad6e304f7a85 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:42.548067 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-65a0be7c-b8fd-42b5-849f-ad6e304f7a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:42.609510 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1405/2790] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:42.620197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:42.621615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:42.680872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc341a-ee73-4ada-9358-ccb0ab686a3a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:42.684607 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e5ef4-7eb8-4dcd-92cd-68c38392fad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:42.685277 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e5ef4-7eb8-4dcd-92cd-68c38392fad5 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:42.685572 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e5ef4-7eb8-4dcd-92cd-68c38392fad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:42.685871 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e5ef4-7eb8-4dcd-92cd-68c38392fad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:42.696714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e5ef4-7eb8-4dcd-92cd-68c38392fad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:42.698382 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e5ef4-7eb8-4dcd-92cd-68c38392fad5 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:42.708897 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1386/2791] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:43.109661 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0be7c-b8fd-42b5-849f-ad6e304f7a85 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:43.111249 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-65a0be7c-b8fd-42b5-849f-ad6e304f7a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:43.124259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0be7c-b8fd-42b5-849f-ad6e304f7a85 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:43.129495 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:43.130374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:43.130658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:43.130974 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] PATH_INFO: `/v3/projects/153b1d2574c54a29836d88f7e85c865d` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:43.132178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=153b1d2574c54a29836d88f7e85c865d)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:43.134142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:43.295354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153b1d2574c54a29836d88f7e85c865d', 'request_id': 'req-2bfa8641-a23c-408a-922c-6e04a5a54793'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.302345 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153b1d2574c54a29836d88f7e85c865d', 'request_id': 'req-2bfa8641-a23c-408a-922c-6e04a5a54793'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.308362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153b1d2574c54a29836d88f7e85c865d', 'request_id': 'req-2bfa8641-a23c-408a-922c-6e04a5a54793'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.407368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:INSERT=3,keystone:SELECT=83,keystone:DELETE=14 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:43.411351 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] The token cache is being invalidate because project 153b1d2574c54a29836d88f7e85c865d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:43.411674 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.414903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.414903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1406/2792] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:43 2022] DELETE /identity/v3/projects/153b1d2574c54a29836d88f7e85c865d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:43.418995 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e5ef4-7eb8-4dcd-92cd-68c38392fad5 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:43.434150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e5ef4-7eb8-4dcd-92cd-68c38392fad5 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:43.495870 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:43.496729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:43.497036 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:43.497311 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] PATH_INFO: `/v3/users/11b694ecae954578a4c925f9247075f2` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:43.498570 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b694ecae954578a4c925f9247075f2)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:43.500531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:43.747464 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b694ecae954578a4c925f9247075f2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.754426 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b694ecae954578a4c925f9247075f2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.755197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b694ecae954578a4c925f9247075f2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.756877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:43.768772 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b694ecae954578a4c925f9247075f2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.769430 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-adc41e74-53d5-4b8d-b520-8dc29ce07d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b694ecae954578a4c925f9247075f2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:43.886547 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1387/2793] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:43 2022] DELETE /identity/v3/users/11b694ecae954578a4c925f9247075f2 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:44.424698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:44.426160 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:44.442250 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa8641-a23c-408a-922c-6e04a5a54793 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:44.501867 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:44.502727 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:44.503013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:44.503297 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] PATH_INFO: `/v3/projects/5b270ec9641c4140bef53f521a611cc9` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:44.504516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b270ec9641c4140bef53f521a611cc9)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:44.506457 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:44.649865 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b270ec9641c4140bef53f521a611cc9', 'request_id': 'req-715d484f-a722-4fae-bc2c-62bd17fbd358'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:44.656151 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b270ec9641c4140bef53f521a611cc9', 'request_id': 'req-715d484f-a722-4fae-bc2c-62bd17fbd358'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:44.661957 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b270ec9641c4140bef53f521a611cc9', 'request_id': 'req-715d484f-a722-4fae-bc2c-62bd17fbd358'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:44.777081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] The token cache is being invalidate because project 5b270ec9641c4140bef53f521a611cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:44.777426 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:44.777994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-715d484f-a722-4fae-bc2c-62bd17fbd358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:44.779599 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1407/2794] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:44 2022] DELETE /identity/v3/projects/5b270ec9641c4140bef53f521a611cc9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:44.784669 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d079-f7a5-454a-a18c-68ba89a07954 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:44.785175 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d079-f7a5-454a-a18c-68ba89a07954 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:44.785294 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d079-f7a5-454a-a18c-68ba89a07954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:44.804092 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f643d079-f7a5-454a-a18c-68ba89a07954 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:44.805291 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f643d079-f7a5-454a-a18c-68ba89a07954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:44.864198 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1388/2795] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:44.872129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935f535-0edd-48d3-b61b-8d98c69b552e None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:44.872430 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935f535-0edd-48d3-b61b-8d98c69b552e None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:44.872705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935f535-0edd-48d3-b61b-8d98c69b552e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:44.891258 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-5935f535-0edd-48d3-b61b-8d98c69b552e None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:44.911698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5935f535-0edd-48d3-b61b-8d98c69b552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:44.911698 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1408/2796] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:44.915189 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643d079-f7a5-454a-a18c-68ba89a07954 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:44.924921 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643d079-f7a5-454a-a18c-68ba89a07954 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:44.929568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc3a64-96d5-4f93-8671-ef85e2942216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:44.930259 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc3a64-96d5-4f93-8671-ef85e2942216 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:44.934427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc3a64-96d5-4f93-8671-ef85e2942216 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:44.934427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc3a64-96d5-4f93-8671-ef85e2942216 admin admin] PATH_INFO: `/v3/domains` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:44.934427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc3a64-96d5-4f93-8671-ef85e2942216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97428) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:12:44.934427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc3a64-96d5-4f93-8671-ef85e2942216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:44.934427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc3a64-96d5-4f93-8671-ef85e2942216 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:44.945258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1389/2797] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:12:44.949777 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935f535-0edd-48d3-b61b-8d98c69b552e None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:44.959004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935f535-0edd-48d3-b61b-8d98c69b552e None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:44.964965 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2554364-4183-495f-a521-7857b887791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:44.965619 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2554364-4183-495f-a521-7857b887791f admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:44.965899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2554364-4183-495f-a521-7857b887791f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:44.966197 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2554364-4183-495f-a521-7857b887791f admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:44.966883 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2554364-4183-495f-a521-7857b887791f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:44.969113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2554364-4183-495f-a521-7857b887791f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:45.090593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1409/2798] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:44 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:45.095615 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc3a64-96d5-4f93-8671-ef85e2942216 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:45.106411 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc3a64-96d5-4f93-8671-ef85e2942216 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:45.161808 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00361675-3374-4404-9f53-09579f8afff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:45.162471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00361675-3374-4404-9f53-09579f8afff4 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:45.162796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00361675-3374-4404-9f53-09579f8afff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:45.163076 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00361675-3374-4404-9f53-09579f8afff4 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:45.163811 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00361675-3374-4404-9f53-09579f8afff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:45.170062 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00361675-3374-4404-9f53-09579f8afff4 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:45.320666 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1390/2799] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:45 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:45.325261 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2554364-4183-495f-a521-7857b887791f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:45.336251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2554364-4183-495f-a521-7857b887791f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:45.340763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40234f5-c026-40fb-8926-a0be89380af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:45.341412 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40234f5-c026-40fb-8926-a0be89380af9 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:45.341694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40234f5-c026-40fb-8926-a0be89380af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:45.342237 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40234f5-c026-40fb-8926-a0be89380af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:45.342952 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40234f5-c026-40fb-8926-a0be89380af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:45.344634 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40234f5-c026-40fb-8926-a0be89380af9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:45.357631 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1410/2800] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:45.359988 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00361675-3374-4404-9f53-09579f8afff4 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:45.369992 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00361675-3374-4404-9f53-09579f8afff4 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:45.374517 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5440052-947b-46ae-bacb-143c80767f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:45.375164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5440052-947b-46ae-bacb-143c80767f7d admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:45.375461 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5440052-947b-46ae-bacb-143c80767f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:45.375777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5440052-947b-46ae-bacb-143c80767f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:45.376488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5440052-947b-46ae-bacb-143c80767f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:45.378153 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5440052-947b-46ae-bacb-143c80767f7d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:45.388529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1391/2801] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:12:45.392835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40234f5-c026-40fb-8926-a0be89380af9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:45.411218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40234f5-c026-40fb-8926-a0be89380af9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:45.425082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5c0c-6fd1-4049-a4d7-c61ada67e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:45.425082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5c0c-6fd1-4049-a4d7-c61ada67e3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:45.425082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5c0c-6fd1-4049-a4d7-c61ada67e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:45.425082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5c0c-6fd1-4049-a4d7-c61ada67e3d6 admin admin] PATH_INFO: `/v3/projects/e8529c5c500548b2b00e639903e6ce3e/users/988ecee950b74f2aac0705d84ddc48f2/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:45.432171 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b5c0c-6fd1-4049-a4d7-c61ada67e3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8529c5c500548b2b00e639903e6ce3e, user_id=988ecee950b74f2aac0705d84ddc48f2, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:45.434884 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b5c0c-6fd1-4049-a4d7-c61ada67e3d6 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:45.509144 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1411/2802] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:45 2022] PUT /identity/v3/projects/e8529c5c500548b2b00e639903e6ce3e/users/988ecee950b74f2aac0705d84ddc48f2/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:45.521927 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acf27e-10aa-4483-ac12-5e71aa018981 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:45.522216 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acf27e-10aa-4483-ac12-5e71aa018981 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:45.522496 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acf27e-10aa-4483-ac12-5e71aa018981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:45.548538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-26acf27e-10aa-4483-ac12-5e71aa018981 None None] MFA Rules not processed for user `988ecee950b74f2aac0705d84ddc48f2`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:45.549796 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-26acf27e-10aa-4483-ac12-5e71aa018981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:45.579612 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:45.614185 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1392/2803] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:45.624872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5c0c-6fd1-4049-a4d7-c61ada67e3d6 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:45.655964 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:45.688393 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5c0c-6fd1-4049-a4d7-c61ada67e3d6 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:45.693188 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c345a8-3fdd-4a2e-a5bb-3402b868db4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:45.693845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c345a8-3fdd-4a2e-a5bb-3402b868db4d admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:45.694664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c345a8-3fdd-4a2e-a5bb-3402b868db4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:45.694942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c345a8-3fdd-4a2e-a5bb-3402b868db4d admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:45.695737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c345a8-3fdd-4a2e-a5bb-3402b868db4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:45.697655 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c345a8-3fdd-4a2e-a5bb-3402b868db4d admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:45.895670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1412/2804] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:45 2022] POST /identity/v3/projects => generated 387 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:45.899787 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acf27e-10aa-4483-ac12-5e71aa018981 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:45.910691 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acf27e-10aa-4483-ac12-5e71aa018981 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:45.967635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba465d-1ef0-4b15-8f18-fc1654734d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:45.968297 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba465d-1ef0-4b15-8f18-fc1654734d10 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:45.968576 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba465d-1ef0-4b15-8f18-fc1654734d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:45.968918 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba465d-1ef0-4b15-8f18-fc1654734d10 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:45.969554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba465d-1ef0-4b15-8f18-fc1654734d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:45.971453 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba465d-1ef0-4b15-8f18-fc1654734d10 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:46.063292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1393/2805] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:45 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:46.067488 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c345a8-3fdd-4a2e-a5bb-3402b868db4d admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:46.077834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c345a8-3fdd-4a2e-a5bb-3402b868db4d admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:46.084024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bba1b-065f-45ca-a19e-cbe824db59b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:46.085192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bba1b-065f-45ca-a19e-cbe824db59b4 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:46.085192 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bba1b-065f-45ca-a19e-cbe824db59b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:46.085405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bba1b-065f-45ca-a19e-cbe824db59b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:46.086177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bba1b-065f-45ca-a19e-cbe824db59b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:46.087934 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bba1b-065f-45ca-a19e-cbe824db59b4 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:46.099511 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1413/2806] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:46.104215 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba465d-1ef0-4b15-8f18-fc1654734d10 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:46.114223 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba465d-1ef0-4b15-8f18-fc1654734d10 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:46.119408 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0b722-0cf2-48a5-8981-9c22a8625387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:46.120091 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0b722-0cf2-48a5-8981-9c22a8625387 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:46.120369 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0b722-0cf2-48a5-8981-9c22a8625387 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:46.123519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0b722-0cf2-48a5-8981-9c22a8625387 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:46.123519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0b722-0cf2-48a5-8981-9c22a8625387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:46.123519 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0b722-0cf2-48a5-8981-9c22a8625387 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:46.134606 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1394/2807] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:46.138938 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bba1b-065f-45ca-a19e-cbe824db59b4 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:46.153324 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bba1b-065f-45ca-a19e-cbe824db59b4 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:46.153795 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d231e-b2f5-455b-a500-32f92af8bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:46.154671 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d231e-b2f5-455b-a500-32f92af8bd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:46.154949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d231e-b2f5-455b-a500-32f92af8bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:46.155226 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d231e-b2f5-455b-a500-32f92af8bd22 admin admin] PATH_INFO: `/v3/projects/ac3d34a5698148039a11db15173d6fbb/users/21c2e5d5230643ac92651c65212d7ae0/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:46.170782 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d231e-b2f5-455b-a500-32f92af8bd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3d34a5698148039a11db15173d6fbb, user_id=21c2e5d5230643ac92651c65212d7ae0, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:46.173879 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d231e-b2f5-455b-a500-32f92af8bd22 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:46.247316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1414/2808] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:46 2022] PUT /identity/v3/projects/ac3d34a5698148039a11db15173d6fbb/users/21c2e5d5230643ac92651c65212d7ae0/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:46.266309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c88a-3dc0-493f-ad65-7498e2142b6d None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:46.266594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c88a-3dc0-493f-ad65-7498e2142b6d None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:46.266872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c88a-3dc0-493f-ad65-7498e2142b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:46.294132 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-6595c88a-3dc0-493f-ad65-7498e2142b6d None None] MFA Rules not processed for user `21c2e5d5230643ac92651c65212d7ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:46.295403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6595c88a-3dc0-493f-ad65-7498e2142b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:46.360052 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1395/2809] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:46.364689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d231e-b2f5-455b-a500-32f92af8bd22 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:46.425664 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d231e-b2f5-455b-a500-32f92af8bd22 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:46.430238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7442a4-4953-4018-b3d0-aff6e39e0b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:46.430886 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7442a4-4953-4018-b3d0-aff6e39e0b67 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:46.431167 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7442a4-4953-4018-b3d0-aff6e39e0b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:46.431439 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7442a4-4953-4018-b3d0-aff6e39e0b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:46.432152 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7442a4-4953-4018-b3d0-aff6e39e0b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:46.434058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7442a4-4953-4018-b3d0-aff6e39e0b67 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:46.536150 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1415/2810] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:12:46 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:46.540678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595c88a-3dc0-493f-ad65-7498e2142b6d None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:46.552086 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595c88a-3dc0-493f-ad65-7498e2142b6d None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:46.589872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:46.620494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef16a9-a1ce-4380-b145-b83eb1c5ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:46.621180 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef16a9-a1ce-4380-b145-b83eb1c5ba99 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:46.621618 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef16a9-a1ce-4380-b145-b83eb1c5ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:46.621920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef16a9-a1ce-4380-b145-b83eb1c5ba99 admin admin] PATH_INFO: `/v3/users` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:46.622713 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef16a9-a1ce-4380-b145-b83eb1c5ba99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:46.624711 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef16a9-a1ce-4380-b145-b83eb1c5ba99 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:46.737193 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1396/2811] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:12:46 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:12:46.738555 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7442a4-4953-4018-b3d0-aff6e39e0b67 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:46.749359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7442a4-4953-4018-b3d0-aff6e39e0b67 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:46.754098 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cef311-7a89-423f-a362-39305ac1721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:46.755244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cef311-7a89-423f-a362-39305ac1721c admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:46.755244 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cef311-7a89-423f-a362-39305ac1721c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:46.755526 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cef311-7a89-423f-a362-39305ac1721c admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:46.756068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cef311-7a89-423f-a362-39305ac1721c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:46.758177 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cef311-7a89-423f-a362-39305ac1721c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:46.773321 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1416/2812] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:46.774502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef16a9-a1ce-4380-b145-b83eb1c5ba99 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:46.784730 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef16a9-a1ce-4380-b145-b83eb1c5ba99 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:46.789475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3797a-f169-46ad-a21a-8ffb832780a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:46.790352 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3797a-f169-46ad-a21a-8ffb832780a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:46.790634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3797a-f169-46ad-a21a-8ffb832780a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:46.790911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3797a-f169-46ad-a21a-8ffb832780a2 admin admin] PATH_INFO: `/v3/projects/2a90725592644236bed3ccac0e1eb666/users/5cfe345442b14a72aa5f68e1ebe0dee3/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:46.807699 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3797a-f169-46ad-a21a-8ffb832780a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a90725592644236bed3ccac0e1eb666, user_id=5cfe345442b14a72aa5f68e1ebe0dee3, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:46.810308 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3797a-f169-46ad-a21a-8ffb832780a2 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:46.922930 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1397/2813] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:46 2022] PUT /identity/v3/projects/2a90725592644236bed3ccac0e1eb666/users/5cfe345442b14a72aa5f68e1ebe0dee3/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:46.927044 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cef311-7a89-423f-a362-39305ac1721c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:46.938366 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cef311-7a89-423f-a362-39305ac1721c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:47.004915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:47.015908 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f18c3-9f03-47cd-b64d-197bb14ee6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:47.016602 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f18c3-9f03-47cd-b64d-197bb14ee6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:47.016891 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f18c3-9f03-47cd-b64d-197bb14ee6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:47.017173 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f18c3-9f03-47cd-b64d-197bb14ee6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:47.017929 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f18c3-9f03-47cd-b64d-197bb14ee6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:47.019535 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f18c3-9f03-47cd-b64d-197bb14ee6f3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:47.031605 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1417/2814] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:12:47.034634 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3797a-f169-46ad-a21a-8ffb832780a2 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:47.045818 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3797a-f169-46ad-a21a-8ffb832780a2 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:47.050624 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20add73-ffbd-4e66-a95a-cde8b662de42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:47.051501 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20add73-ffbd-4e66-a95a-cde8b662de42 admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:47.051814 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20add73-ffbd-4e66-a95a-cde8b662de42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:47.052090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20add73-ffbd-4e66-a95a-cde8b662de42 admin admin] PATH_INFO: `/v3/projects/2a90725592644236bed3ccac0e1eb666/users/5cfe345442b14a72aa5f68e1ebe0dee3/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:47.054659 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20add73-ffbd-4e66-a95a-cde8b662de42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a90725592644236bed3ccac0e1eb666, user_id=5cfe345442b14a72aa5f68e1ebe0dee3, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:47.057400 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20add73-ffbd-4e66-a95a-cde8b662de42 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:47.072344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1398/2815] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:12:47 2022] PUT /identity/v3/projects/2a90725592644236bed3ccac0e1eb666/users/5cfe345442b14a72aa5f68e1ebe0dee3/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:47.087020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17376b0c-4862-4b9c-899c-4579b834afe3 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:47.087515 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17376b0c-4862-4b9c-899c-4579b834afe3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:47.088442 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17376b0c-4862-4b9c-899c-4579b834afe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:47.134206 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-17376b0c-4862-4b9c-899c-4579b834afe3 None None] MFA Rules not processed for user `5cfe345442b14a72aa5f68e1ebe0dee3`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:47.136020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-17376b0c-4862-4b9c-899c-4579b834afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:47.220128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1418/2816] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:47.230609 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20add73-ffbd-4e66-a95a-cde8b662de42 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:47.232347 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-d20add73-ffbd-4e66-a95a-cde8b662de42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:47.298182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20add73-ffbd-4e66-a95a-cde8b662de42 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:47.298182 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b76acf-004c-44ae-876e-aefb430f2b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:47.298778 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b76acf-004c-44ae-876e-aefb430f2b33 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:47.299061 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b76acf-004c-44ae-876e-aefb430f2b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:47.299334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b76acf-004c-44ae-876e-aefb430f2b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:47.309743 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b76acf-004c-44ae-876e-aefb430f2b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:47.311224 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b76acf-004c-44ae-876e-aefb430f2b33 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:47.321635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1399/2817] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:48.484947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17376b0c-4862-4b9c-899c-4579b834afe3 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:48.495716 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17376b0c-4862-4b9c-899c-4579b834afe3 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:48.499752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0876e-f193-42af-92f9-83e507f05263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:48.500404 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0876e-f193-42af-92f9-83e507f05263 service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:48.500745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0876e-f193-42af-92f9-83e507f05263 service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:48.501020 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0876e-f193-42af-92f9-83e507f05263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:48.565344 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0876e-f193-42af-92f9-83e507f05263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:48.566787 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0876e-f193-42af-92f9-83e507f05263 service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:48.576159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1419/2818] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:53.611459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b76acf-004c-44ae-876e-aefb430f2b33 service cinder] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:53.620993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b76acf-004c-44ae-876e-aefb430f2b33 service cinder] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:53.625292 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09e836-fce4-4d47-aee2-88fa73b11dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:53.626328 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09e836-fce4-4d47-aee2-88fa73b11dea service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:53.626810 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09e836-fce4-4d47-aee2-88fa73b11dea service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:53.627154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09e836-fce4-4d47-aee2-88fa73b11dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:53.688202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09e836-fce4-4d47-aee2-88fa73b11dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:53.689672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09e836-fce4-4d47-aee2-88fa73b11dea service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:53.699139 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1400/2819] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:58.536433 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0876e-f193-42af-92f9-83e507f05263 service cinder] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:58.599235 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0876e-f193-42af-92f9-83e507f05263 service cinder] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:58.604271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:58.608682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:58.608682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:58.608682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] PATH_INFO: `/v3/users/988ecee950b74f2aac0705d84ddc48f2` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:58.608682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988ecee950b74f2aac0705d84ddc48f2)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:58.609095 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:58.621906 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:58.899509 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988ecee950b74f2aac0705d84ddc48f2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.024905 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988ecee950b74f2aac0705d84ddc48f2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.032882 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988ecee950b74f2aac0705d84ddc48f2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.045615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988ecee950b74f2aac0705d84ddc48f2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.046259 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988ecee950b74f2aac0705d84ddc48f2'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.052084 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1420/2820] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:58 2022] DELETE /identity/v3/users/988ecee950b74f2aac0705d84ddc48f2 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:59.056672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80309-b82d-4ab9-aba4-86f387b221f8 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:59.057172 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80309-b82d-4ab9-aba4-86f387b221f8 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:59.057315 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80309-b82d-4ab9-aba4-86f387b221f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:59.075422 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-8ba80309-b82d-4ab9-aba4-86f387b221f8 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:12:59.076701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8ba80309-b82d-4ab9-aba4-86f387b221f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:59.103219 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:12:59.136993 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1401/2821] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:12:59.146629 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:59.148073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:59.206417 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836a5da-c9f5-4e11-9153-a3a63f0ec4f9 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:59.209982 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ed900-f12a-45e7-a139-3dedaf12b9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:59.210615 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ed900-f12a-45e7-a139-3dedaf12b9bf service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:59.210895 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ed900-f12a-45e7-a139-3dedaf12b9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:59.211168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ed900-f12a-45e7-a139-3dedaf12b9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:59.221830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ed900-f12a-45e7-a139-3dedaf12b9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:59.223326 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ed900-f12a-45e7-a139-3dedaf12b9bf service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:59.233497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1421/2822] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:12:59.626647 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba80309-b82d-4ab9-aba4-86f387b221f8 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:59.628582 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-8ba80309-b82d-4ab9-aba4-86f387b221f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:12:59.641406 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba80309-b82d-4ab9-aba4-86f387b221f8 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:59.645961 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:59.646935 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:59.647217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:59.647661 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] PATH_INFO: `/v3/projects/e8529c5c500548b2b00e639903e6ce3e` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:59.648888 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8529c5c500548b2b00e639903e6ce3e)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:59.655774 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:12:59.780783 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8529c5c500548b2b00e639903e6ce3e', 'request_id': 'req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.787018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8529c5c500548b2b00e639903e6ce3e', 'request_id': 'req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.792802 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8529c5c500548b2b00e639903e6ce3e', 'request_id': 'req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.896282 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] The token cache is being invalidate because project e8529c5c500548b2b00e639903e6ce3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:12:59.896499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.897093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:12:59.898640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1402/2823] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:12:59 2022] DELETE /identity/v3/projects/e8529c5c500548b2b00e639903e6ce3e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:12:59.902613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ed900-f12a-45e7-a139-3dedaf12b9bf service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:12:59.912278 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ed900-f12a-45e7-a139-3dedaf12b9bf service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:12:59.970675 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:12:59.971587 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:12:59.971877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:12:59.972178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] PATH_INFO: `/v3/users/21c2e5d5230643ac92651c65212d7ae0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:12:59.973355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c2e5d5230643ac92651c65212d7ae0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:12:59.975281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:00.209911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:00.220081 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c2e5d5230643ac92651c65212d7ae0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.309223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c2e5d5230643ac92651c65212d7ae0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.316613 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c2e5d5230643ac92651c65212d7ae0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.328658 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c2e5d5230643ac92651c65212d7ae0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.329337 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c2e5d5230643ac92651c65212d7ae0'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.335240 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1422/2824] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:12:59 2022] DELETE /identity/v3/users/21c2e5d5230643ac92651c65212d7ae0 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:00.775161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:00.777344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:00.790592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7581b-66a9-46a1-aa1d-0cbdd97d23a2 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:00.847770 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:00.848625 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:00.848908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:00.849179 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] PATH_INFO: `/v3/projects/ac3d34a5698148039a11db15173d6fbb` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:00.850358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac3d34a5698148039a11db15173d6fbb)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:00.852337 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:00.977527 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3d34a5698148039a11db15173d6fbb', 'request_id': 'req-cd25eb12-bb36-41e0-b88b-434243702bf0'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.983861 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3d34a5698148039a11db15173d6fbb', 'request_id': 'req-cd25eb12-bb36-41e0-b88b-434243702bf0'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:00.985841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:00.989718 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3d34a5698148039a11db15173d6fbb', 'request_id': 'req-cd25eb12-bb36-41e0-b88b-434243702bf0'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.121676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] The token cache is being invalidate because project ac3d34a5698148039a11db15173d6fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:01.121676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.121676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.121676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1403/2825] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:13:00 2022] DELETE /identity/v3/projects/ac3d34a5698148039a11db15173d6fbb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:01.123271 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:01.124812 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:01.139512 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53290450-619b-4bd3-b71b-61f6406a0ea5 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:01.198531 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:01.199498 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:01.199899 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:01.200179 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] PATH_INFO: `/v3/users/5cfe345442b14a72aa5f68e1ebe0dee3` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:01.201405 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfe345442b14a72aa5f68e1ebe0dee3)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:01.203332 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:01.571087 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfe345442b14a72aa5f68e1ebe0dee3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.676859 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfe345442b14a72aa5f68e1ebe0dee3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.685611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfe345442b14a72aa5f68e1ebe0dee3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.698601 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfe345442b14a72aa5f68e1ebe0dee3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.699354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-dd77a9ec-2be6-43fe-802f-3b76b10c2171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfe345442b14a72aa5f68e1ebe0dee3'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:01.705424 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1423/2826] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:13:01 2022] DELETE /identity/v3/users/5cfe345442b14a72aa5f68e1ebe0dee3 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:02.149807 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.152630 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:02.167078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25eb12-bb36-41e0-b88b-434243702bf0 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.241244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.242156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.242441 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.242716 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] PATH_INFO: `/v3/projects/2a90725592644236bed3ccac0e1eb666` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.243952 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a90725592644236bed3ccac0e1eb666)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.245939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.375402 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a90725592644236bed3ccac0e1eb666', 'request_id': 'req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.381908 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a90725592644236bed3ccac0e1eb666', 'request_id': 'req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.387904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a90725592644236bed3ccac0e1eb666', 'request_id': 'req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.461751 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] The token cache is being invalidate because project 2a90725592644236bed3ccac0e1eb666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:02.462044 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.462674 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-e02ae5cf-74c4-412a-9ec3-559a14aa6fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:02.464827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1404/2827] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:13:02 2022] DELETE /identity/v3/projects/2a90725592644236bed3ccac0e1eb666 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:02.471080 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e1b36-26ee-4401-b8a4-d5f48f7a46ec None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.471645 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e1b36-26ee-4401-b8a4-d5f48f7a46ec None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.471761 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e1b36-26ee-4401-b8a4-d5f48f7a46ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.490262 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-bf8e1b36-26ee-4401-b8a4-d5f48f7a46ec None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:02.491475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-bf8e1b36-26ee-4401-b8a4-d5f48f7a46ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:02.517892 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:02.551784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1424/2828] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:02.561473 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a04bf-f934-4940-b72e-9aabf40026b7 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.561879 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a04bf-f934-4940-b72e-9aabf40026b7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.562313 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a04bf-f934-4940-b72e-9aabf40026b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.581744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-741a04bf-f934-4940-b72e-9aabf40026b7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:02.583471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-741a04bf-f934-4940-b72e-9aabf40026b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:02.594065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1405/2829] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:02.598722 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e1b36-26ee-4401-b8a4-d5f48f7a46ec None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.608949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e1b36-26ee-4401-b8a4-d5f48f7a46ec None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.613835 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a38df-dfe9-47a9-888e-ab3f3453031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.614517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a38df-dfe9-47a9-888e-ab3f3453031c admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.614873 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a38df-dfe9-47a9-888e-ab3f3453031c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.615159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a38df-dfe9-47a9-888e-ab3f3453031c admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.615925 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a38df-dfe9-47a9-888e-ab3f3453031c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:13:02.616234 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a38df-dfe9-47a9-888e-ab3f3453031c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.617843 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a38df-dfe9-47a9-888e-ab3f3453031c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.631329 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1425/2830] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:13:02.636346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a04bf-f934-4940-b72e-9aabf40026b7 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.645847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a04bf-f934-4940-b72e-9aabf40026b7 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.651909 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e44d9-89e6-4f48-b4f9-ab6f0614be9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.652560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e44d9-89e6-4f48-b4f9-ab6f0614be9f admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.654124 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e44d9-89e6-4f48-b4f9-ab6f0614be9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.654407 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e44d9-89e6-4f48-b4f9-ab6f0614be9f admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.655114 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e44d9-89e6-4f48-b4f9-ab6f0614be9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.657096 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e44d9-89e6-4f48-b4f9-ab6f0614be9f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.758370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1406/2831] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:13:02 2022] POST /identity/v3/projects => generated 359 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:02.763129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a38df-dfe9-47a9-888e-ab3f3453031c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.773302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a38df-dfe9-47a9-888e-ab3f3453031c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.831646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4d00d-1db8-4801-8e62-c73815d9078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.832316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4d00d-1db8-4801-8e62-c73815d9078c admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.832603 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4d00d-1db8-4801-8e62-c73815d9078c admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.832877 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4d00d-1db8-4801-8e62-c73815d9078c admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.833574 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4d00d-1db8-4801-8e62-c73815d9078c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.835499 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4d00d-1db8-4801-8e62-c73815d9078c admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.945107 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1426/2832] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:13:02 2022] POST /identity/v3/users => generated 280 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:02.949929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e44d9-89e6-4f48-b4f9-ab6f0614be9f admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.960169 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e44d9-89e6-4f48-b4f9-ab6f0614be9f admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.964830 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7d272-4e20-4f79-a012-d40b79b5237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.965475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7d272-4e20-4f79-a012-d40b79b5237f admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.965754 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7d272-4e20-4f79-a012-d40b79b5237f admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.966023 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7d272-4e20-4f79-a012-d40b79b5237f admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:02.966741 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7d272-4e20-4f79-a012-d40b79b5237f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:02.968695 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7d272-4e20-4f79-a012-d40b79b5237f admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:02.979065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1407/2833] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:02.983062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4d00d-1db8-4801-8e62-c73815d9078c admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:02.993190 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4d00d-1db8-4801-8e62-c73815d9078c admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:02.998728 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb17c66-9eec-4e18-be2a-8e376905e424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:02.999387 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb17c66-9eec-4e18-be2a-8e376905e424 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:02.999717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb17c66-9eec-4e18-be2a-8e376905e424 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:02.999993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb17c66-9eec-4e18-be2a-8e376905e424 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:03.000717 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb17c66-9eec-4e18-be2a-8e376905e424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:03.002436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb17c66-9eec-4e18-be2a-8e376905e424 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:03.014694 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1427/2834] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:03.018792 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7d272-4e20-4f79-a012-d40b79b5237f admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:03.028997 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7d272-4e20-4f79-a012-d40b79b5237f admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:03.033799 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978623-c4b8-4590-aba8-958efb5811bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:03.034701 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978623-c4b8-4590-aba8-958efb5811bd admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:03.035009 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978623-c4b8-4590-aba8-958efb5811bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:03.035286 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978623-c4b8-4590-aba8-958efb5811bd admin admin] PATH_INFO: `/v3/projects/6a450e7baeca4ae39cb2a400c9d941f0/users/b530eca2cd684c70ab9620da77183f87/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:03.050652 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978623-c4b8-4590-aba8-958efb5811bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a450e7baeca4ae39cb2a400c9d941f0, user_id=b530eca2cd684c70ab9620da77183f87, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:03.053338 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978623-c4b8-4590-aba8-958efb5811bd admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:03.160608 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1408/2835] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:13:03 2022] PUT /identity/v3/projects/6a450e7baeca4ae39cb2a400c9d941f0/users/b530eca2cd684c70ab9620da77183f87/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:03.172662 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df9dd0-249a-4458-9082-21575d765234 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:03.172951 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df9dd0-249a-4458-9082-21575d765234 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:03.173233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df9dd0-249a-4458-9082-21575d765234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:03.201548 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-d6df9dd0-249a-4458-9082-21575d765234 None None] MFA Rules not processed for user `b530eca2cd684c70ab9620da77183f87`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:03.202762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d6df9dd0-249a-4458-9082-21575d765234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:03.267012 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1428/2836] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:03 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:03.307693 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978623-c4b8-4590-aba8-958efb5811bd admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:03.309486 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-24978623-c4b8-4590-aba8-958efb5811bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:03.323326 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:03.367601 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978623-c4b8-4590-aba8-958efb5811bd admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:03.371965 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5256a-f6e4-4730-acf2-6fd24aaebfdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:03.372599 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5256a-f6e4-4730-acf2-6fd24aaebfdb service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:03.372875 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5256a-f6e4-4730-acf2-6fd24aaebfdb service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:03.373148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5256a-f6e4-4730-acf2-6fd24aaebfdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:03.381412 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5256a-f6e4-4730-acf2-6fd24aaebfdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:03.382846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5256a-f6e4-4730-acf2-6fd24aaebfdb service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:03.391427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1409/2837] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:03 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:13:03.406049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df9dd0-249a-4458-9082-21575d765234 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:03.436970 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:03.469968 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df9dd0-249a-4458-9082-21575d765234 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:03.474845 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:03.475745 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:03.476026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:03.476302 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] PATH_INFO: `/v3/users/b530eca2cd684c70ab9620da77183f87` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:03.477552 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b530eca2cd684c70ab9620da77183f87)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:03.480343 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:03.787374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b530eca2cd684c70ab9620da77183f87'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:03.899775 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b530eca2cd684c70ab9620da77183f87'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:03.907283 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b530eca2cd684c70ab9620da77183f87'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:03.920293 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b530eca2cd684c70ab9620da77183f87'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:03.921062 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b530eca2cd684c70ab9620da77183f87'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:03.927003 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1429/2838] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:13:03 2022] DELETE /identity/v3/users/b530eca2cd684c70ab9620da77183f87 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:03.932363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb5648-7446-48f2-a87c-e3ef88b73c15 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:03.932648 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb5648-7446-48f2-a87c-e3ef88b73c15 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:03.932877 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb5648-7446-48f2-a87c-e3ef88b73c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:03.950113 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-7dfb5648-7446-48f2-a87c-e3ef88b73c15 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:03.951299 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7dfb5648-7446-48f2-a87c-e3ef88b73c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:04.009463 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1410/2839] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:04.019147 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:04.020612 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:04.080481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674ef0-b0a5-4460-9bb4-a9a31d53b3d7 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:04.084047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab766b-00e4-463a-a249-66be2aaf3d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:04.090129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab766b-00e4-463a-a249-66be2aaf3d43 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:04.090129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab766b-00e4-463a-a249-66be2aaf3d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:04.090129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab766b-00e4-463a-a249-66be2aaf3d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:04.094736 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab766b-00e4-463a-a249-66be2aaf3d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:04.096210 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab766b-00e4-463a-a249-66be2aaf3d43 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:04.106523 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1430/2840] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:04.563263 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb5648-7446-48f2-a87c-e3ef88b73c15 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:04.564834 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-7dfb5648-7446-48f2-a87c-e3ef88b73c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:04.577268 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb5648-7446-48f2-a87c-e3ef88b73c15 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:04.582329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:04.583395 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:04.584090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:04.584090 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] PATH_INFO: `/v3/projects/6a450e7baeca4ae39cb2a400c9d941f0` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:04.585925 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a450e7baeca4ae39cb2a400c9d941f0)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:04.588104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:04.735425 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a450e7baeca4ae39cb2a400c9d941f0', 'request_id': 'req-638f7309-4f82-4c0c-81f4-1ae6ff478f24'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:04.741714 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a450e7baeca4ae39cb2a400c9d941f0', 'request_id': 'req-638f7309-4f82-4c0c-81f4-1ae6ff478f24'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:04.747775 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a450e7baeca4ae39cb2a400c9d941f0', 'request_id': 'req-638f7309-4f82-4c0c-81f4-1ae6ff478f24'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:04.847511 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] The token cache is being invalidate because project 6a450e7baeca4ae39cb2a400c9d941f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:04.847837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:04.851676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-638f7309-4f82-4c0c-81f4-1ae6ff478f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:04.851676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1411/2841] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:13:04 2022] DELETE /identity/v3/projects/6a450e7baeca4ae39cb2a400c9d941f0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:04.855155 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f140ab3-767c-42ca-b4f0-09baee35b884 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:04.855862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f140ab3-767c-42ca-b4f0-09baee35b884 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:04.855862 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f140ab3-767c-42ca-b4f0-09baee35b884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:04.873608 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1f140ab3-767c-42ca-b4f0-09baee35b884 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:04.874808 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1f140ab3-767c-42ca-b4f0-09baee35b884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:04.918763 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:04.937410 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1431/2842] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:04.945435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4030f-869d-42fc-b2da-419a119c2918 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:04.945724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4030f-869d-42fc-b2da-419a119c2918 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:04.946065 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4030f-869d-42fc-b2da-419a119c2918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:04.965127 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-9da4030f-869d-42fc-b2da-419a119c2918 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:04.966329 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9da4030f-869d-42fc-b2da-419a119c2918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:04.974939 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1412/2843] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:04.979514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f140ab3-767c-42ca-b4f0-09baee35b884 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:04.989864 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f140ab3-767c-42ca-b4f0-09baee35b884 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:04.995611 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadea7a-a03c-4fb8-80bd-ccc55b5bc6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.000378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadea7a-a03c-4fb8-80bd-ccc55b5bc6ff admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.000378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadea7a-a03c-4fb8-80bd-ccc55b5bc6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.000378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadea7a-a03c-4fb8-80bd-ccc55b5bc6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.000378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadea7a-a03c-4fb8-80bd-ccc55b5bc6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:13:05.000378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadea7a-a03c-4fb8-80bd-ccc55b5bc6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.000378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadea7a-a03c-4fb8-80bd-ccc55b5bc6ff admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.013705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1432/2844] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:13:05.018431 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4030f-869d-42fc-b2da-419a119c2918 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.030522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4030f-869d-42fc-b2da-419a119c2918 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.035795 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6098dc-73d8-4f80-be52-b81369b75ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.036548 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6098dc-73d8-4f80-be52-b81369b75ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.036982 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6098dc-73d8-4f80-be52-b81369b75ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.037366 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6098dc-73d8-4f80-be52-b81369b75ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.038150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6098dc-73d8-4f80-be52-b81369b75ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.040372 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6098dc-73d8-4f80-be52-b81369b75ea0 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.157776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1413/2845] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:13:05 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:13:05.162104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadea7a-a03c-4fb8-80bd-ccc55b5bc6ff admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.174209 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadea7a-a03c-4fb8-80bd-ccc55b5bc6ff admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.233810 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837f0b1-bf6b-4058-921a-203812714efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.234553 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f0b1-bf6b-4058-921a-203812714efc admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.234834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f0b1-bf6b-4058-921a-203812714efc admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.235114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f0b1-bf6b-4058-921a-203812714efc admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.235850 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837f0b1-bf6b-4058-921a-203812714efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.237784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837f0b1-bf6b-4058-921a-203812714efc admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.377516 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1433/2846] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:13:05 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:05.381880 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6098dc-73d8-4f80-be52-b81369b75ea0 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.394287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6098dc-73d8-4f80-be52-b81369b75ea0 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.399476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db2873-4c26-445a-9cc1-033495728cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.400950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db2873-4c26-445a-9cc1-033495728cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.401241 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db2873-4c26-445a-9cc1-033495728cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.401521 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db2873-4c26-445a-9cc1-033495728cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.402287 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db2873-4c26-445a-9cc1-033495728cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.404197 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db2873-4c26-445a-9cc1-033495728cf3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.406867 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:05.416626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1414/2847] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:05.421120 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837f0b1-bf6b-4058-921a-203812714efc admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.432182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837f0b1-bf6b-4058-921a-203812714efc admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.437128 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c572331-52da-42c2-9ef5-a185afcba6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.437808 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c572331-52da-42c2-9ef5-a185afcba6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.438097 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c572331-52da-42c2-9ef5-a185afcba6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.438378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c572331-52da-42c2-9ef5-a185afcba6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.439115 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c572331-52da-42c2-9ef5-a185afcba6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.440942 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c572331-52da-42c2-9ef5-a185afcba6a8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.453065 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1434/2848] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:05.457977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db2873-4c26-445a-9cc1-033495728cf3 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.469042 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db2873-4c26-445a-9cc1-033495728cf3 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.474144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8811f17-ae32-4d5e-a92a-a09f74d7d35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.475064 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8811f17-ae32-4d5e-a92a-a09f74d7d35a admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.475334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8811f17-ae32-4d5e-a92a-a09f74d7d35a admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.475660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8811f17-ae32-4d5e-a92a-a09f74d7d35a admin admin] PATH_INFO: `/v3/projects/d488e79dea864f449d665350cb1d6137/users/a29df6ebb247404584da3f4bd70356be/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.490380 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8811f17-ae32-4d5e-a92a-a09f74d7d35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d488e79dea864f449d665350cb1d6137, user_id=a29df6ebb247404584da3f4bd70356be, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.493161 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8811f17-ae32-4d5e-a92a-a09f74d7d35a admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.588869 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1415/2849] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:13:05 2022] PUT /identity/v3/projects/d488e79dea864f449d665350cb1d6137/users/a29df6ebb247404584da3f4bd70356be/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:05.601099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033d1a-dba8-4f88-87d8-71a3f724c31d None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.601391 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033d1a-dba8-4f88-87d8-71a3f724c31d None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.601670 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033d1a-dba8-4f88-87d8-71a3f724c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.628036 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-47033d1a-dba8-4f88-87d8-71a3f724c31d None None] MFA Rules not processed for user `a29df6ebb247404584da3f4bd70356be`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:05.629225 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-47033d1a-dba8-4f88-87d8-71a3f724c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:05.703437 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1435/2850] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:05.714904 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8811f17-ae32-4d5e-a92a-a09f74d7d35a admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.716650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f8811f17-ae32-4d5e-a92a-a09f74d7d35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:05.780592 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8811f17-ae32-4d5e-a92a-a09f74d7d35a admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.784865 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d025e7-3e6d-4532-bab6-f4aa33335394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.785560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d025e7-3e6d-4532-bab6-f4aa33335394 service cinder] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.785872 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d025e7-3e6d-4532-bab6-f4aa33335394 service cinder] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.786156 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d025e7-3e6d-4532-bab6-f4aa33335394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.794953 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d025e7-3e6d-4532-bab6-f4aa33335394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.796476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d025e7-3e6d-4532-bab6-f4aa33335394 service cinder] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:05.805658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1416/2851] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:05.833025 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033d1a-dba8-4f88-87d8-71a3f724c31d None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:05.883223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:05.903791 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033d1a-dba8-4f88-87d8-71a3f724c31d None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:05.909013 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:05.909889 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:05.910176 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:05.910451 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] PATH_INFO: `/v3/users/a29df6ebb247404584da3f4bd70356be` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:05.911697 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29df6ebb247404584da3f4bd70356be)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:05.913665 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:06.310257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29df6ebb247404584da3f4bd70356be'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:06.405104 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29df6ebb247404584da3f4bd70356be'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:06.412472 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29df6ebb247404584da3f4bd70356be'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:06.424649 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29df6ebb247404584da3f4bd70356be'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:06.425379 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29df6ebb247404584da3f4bd70356be'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:06.431530 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1436/2852] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:13:05 2022] DELETE /identity/v3/users/a29df6ebb247404584da3f4bd70356be => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:06.436855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9721-4883-478e-9c9e-fb16d276d9fd None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:06.437168 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9721-4883-478e-9c9e-fb16d276d9fd None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:06.437457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9721-4883-478e-9c9e-fb16d276d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:06.457660 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-227c9721-4883-478e-9c9e-fb16d276d9fd None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:06.458836 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-227c9721-4883-478e-9c9e-fb16d276d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:06.518094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1417/2853] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:06.528017 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:06.529475 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:06.590018 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cdb65-f087-4a1d-b82f-ddafb6b1252f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:06.595750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbe5ed-3733-431c-b905-d63240877b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:06.596415 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbe5ed-3733-431c-b905-d63240877b23 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:06.596703 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbe5ed-3733-431c-b905-d63240877b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:06.596999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbe5ed-3733-431c-b905-d63240877b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:06.606683 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbe5ed-3733-431c-b905-d63240877b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:06.608186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbe5ed-3733-431c-b905-d63240877b23 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:06.617878 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1437/2854] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:07.019032 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c9721-4883-478e-9c9e-fb16d276d9fd None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.024892 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-227c9721-4883-478e-9c9e-fb16d276d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:07.034956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c9721-4883-478e-9c9e-fb16d276d9fd None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.040387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.044120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.044475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.045271 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] PATH_INFO: `/v3/projects/d488e79dea864f449d665350cb1d6137` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.047950 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d488e79dea864f449d665350cb1d6137)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.049914 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.173928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd488e79dea864f449d665350cb1d6137', 'request_id': 'req-dda549ef-903a-4a8d-b7d5-407c95359394'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.180057 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd488e79dea864f449d665350cb1d6137', 'request_id': 'req-dda549ef-903a-4a8d-b7d5-407c95359394'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.185538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd488e79dea864f449d665350cb1d6137', 'request_id': 'req-dda549ef-903a-4a8d-b7d5-407c95359394'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.266094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:07.269971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] The token cache is being invalidate because project d488e79dea864f449d665350cb1d6137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:07.272819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.272819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.272819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1418/2855] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:13:07 2022] DELETE /identity/v3/projects/d488e79dea864f449d665350cb1d6137 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:07.278114 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f9315-bd08-4b54-9008-2d7550ac1e57 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.278900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f9315-bd08-4b54-9008-2d7550ac1e57 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.278900 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f9315-bd08-4b54-9008-2d7550ac1e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.301401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-c48f9315-bd08-4b54-9008-2d7550ac1e57 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:07.301401 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c48f9315-bd08-4b54-9008-2d7550ac1e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:07.323617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.327418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:07.364801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1438/2856] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:13:07.372182 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fae1c-22e9-455e-bf0a-75d2ffd380d3 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.372467 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fae1c-22e9-455e-bf0a-75d2ffd380d3 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.372739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fae1c-22e9-455e-bf0a-75d2ffd380d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.384963 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:07.391356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-1f7fae1c-22e9-455e-bf0a-75d2ffd380d3 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:07.392367 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda549ef-903a-4a8d-b7d5-407c95359394 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.392593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-1f7fae1c-22e9-455e-bf0a-75d2ffd380d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:07.397251 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.398210 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.398497 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.398777 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] PATH_INFO: `/v3/users/4d034de215164ccd8419fb7a9a8b294a` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.400551 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d034de215164ccd8419fb7a9a8b294a)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.401233 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1439/2857] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:07.402538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.405340 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fae1c-22e9-455e-bf0a-75d2ffd380d3 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.414392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fae1c-22e9-455e-bf0a-75d2ffd380d3 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.419834 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac2c40-c9a0-48a8-b147-e89fa57d4408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.420474 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac2c40-c9a0-48a8-b147-e89fa57d4408 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.420754 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac2c40-c9a0-48a8-b147-e89fa57d4408 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.421026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac2c40-c9a0-48a8-b147-e89fa57d4408 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.421887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac2c40-c9a0-48a8-b147-e89fa57d4408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:13:07.422196 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac2c40-c9a0-48a8-b147-e89fa57d4408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.423937 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac2c40-c9a0-48a8-b147-e89fa57d4408 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.436949 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1440/2858] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:13:07.441165 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac2c40-c9a0-48a8-b147-e89fa57d4408 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.450742 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac2c40-c9a0-48a8-b147-e89fa57d4408 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.455299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8975b1-fab2-4b68-87dc-90fc07c06c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.455947 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8975b1-fab2-4b68-87dc-90fc07c06c58 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.456230 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8975b1-fab2-4b68-87dc-90fc07c06c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.456505 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8975b1-fab2-4b68-87dc-90fc07c06c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.457186 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8975b1-fab2-4b68-87dc-90fc07c06c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.459073 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8975b1-fab2-4b68-87dc-90fc07c06c58 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.576607 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1441/2859] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:13:07 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:13:07.578811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8975b1-fab2-4b68-87dc-90fc07c06c58 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.639701 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8975b1-fab2-4b68-87dc-90fc07c06c58 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.644743 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f5a2-4e2e-45f1-960a-8dda903062cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.645514 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f5a2-4e2e-45f1-960a-8dda903062cf admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.645800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f5a2-4e2e-45f1-960a-8dda903062cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.646118 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f5a2-4e2e-45f1-960a-8dda903062cf admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.646811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f5a2-4e2e-45f1-960a-8dda903062cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.648778 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f5a2-4e2e-45f1-960a-8dda903062cf admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.656985 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d034de215164ccd8419fb7a9a8b294a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.663749 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d034de215164ccd8419fb7a9a8b294a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.664643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d034de215164ccd8419fb7a9a8b294a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.676675 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d034de215164ccd8419fb7a9a8b294a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.677442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6fe280e0-8693-4ca3-a172-3f634c3f0537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d034de215164ccd8419fb7a9a8b294a'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:07.744913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1442/2860] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:13:07 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:13:07.748858 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f5a2-4e2e-45f1-960a-8dda903062cf admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.750456 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-a9f8f5a2-4e2e-45f1-960a-8dda903062cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:07.762641 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f5a2-4e2e-45f1-960a-8dda903062cf admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.767272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2b95d-fd5e-42cc-994f-d2650ce128c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.767939 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2b95d-fd5e-42cc-994f-d2650ce128c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.768224 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2b95d-fd5e-42cc-994f-d2650ce128c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.768500 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2b95d-fd5e-42cc-994f-d2650ce128c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.769202 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2b95d-fd5e-42cc-994f-d2650ce128c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.770788 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2b95d-fd5e-42cc-994f-d2650ce128c1 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.782217 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1443/2861] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:13:07.785355 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1419/2862] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:13:07 2022] DELETE /identity/v3/users/4d034de215164ccd8419fb7a9a8b294a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:07.795355 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2b95d-fd5e-42cc-994f-d2650ce128c1 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.795497 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2b95d-fd5e-42cc-994f-d2650ce128c1 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.798476 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb7e96-7382-4020-a778-8a6f2a545ca7 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.798764 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb7e96-7382-4020-a778-8a6f2a545ca7 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.799035 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb7e96-7382-4020-a778-8a6f2a545ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.816611 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-4deb7e96-7382-4020-a778-8a6f2a545ca7 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:07.817803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4deb7e96-7382-4020-a778-8a6f2a545ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:07.861784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f0cbb-7530-4ddd-98e8-98cb21fb570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.861784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f0cbb-7530-4ddd-98e8-98cb21fb570f admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.861784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f0cbb-7530-4ddd-98e8-98cb21fb570f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.861784 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f0cbb-7530-4ddd-98e8-98cb21fb570f admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.862305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f0cbb-7530-4ddd-98e8-98cb21fb570f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.862305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f0cbb-7530-4ddd-98e8-98cb21fb570f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.866256 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1444/2863] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:07.870903 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f0cbb-7530-4ddd-98e8-98cb21fb570f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.877007 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1420/2864] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:13:07.880863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f0cbb-7530-4ddd-98e8-98cb21fb570f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.885999 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b73c-61ef-4ae5-b010-d0ccaafe95a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.886874 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b73c-61ef-4ae5-b010-d0ccaafe95a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.887011 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb7e96-7382-4020-a778-8a6f2a545ca7 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:07.887299 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b73c-61ef-4ae5-b010-d0ccaafe95a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.887593 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b73c-61ef-4ae5-b010-d0ccaafe95a2 admin admin] PATH_INFO: `/v3/projects/9310407185ae4b9fa2601fa4469eaff2/users/87cc8f4f121148498e2b0550b09e68e2/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.888508 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4deb7e96-7382-4020-a778-8a6f2a545ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:07.903068 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02b73c-61ef-4ae5-b010-d0ccaafe95a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9310407185ae4b9fa2601fa4469eaff2, user_id=87cc8f4f121148498e2b0550b09e68e2, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.905765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02b73c-61ef-4ae5-b010-d0ccaafe95a2 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.944552 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb7e96-7382-4020-a778-8a6f2a545ca7 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:07.948442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f54be-d4ca-4091-b525-7b1531d05ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:07.949112 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f54be-d4ca-4091-b525-7b1531d05ccc service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.949394 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f54be-d4ca-4091-b525-7b1531d05ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.949671 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f54be-d4ca-4091-b525-7b1531d05ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:07.958629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f54be-d4ca-4091-b525-7b1531d05ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:07.960098 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f54be-d4ca-4091-b525-7b1531d05ccc service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:07.970283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1421/2865] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:07.988281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1445/2866] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:13:07 2022] PUT /identity/v3/projects/9310407185ae4b9fa2601fa4469eaff2/users/87cc8f4f121148498e2b0550b09e68e2/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:07.998530 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5f9ea-0910-4ce1-aa80-eb6de4bb0967 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:07.998819 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5f9ea-0910-4ce1-aa80-eb6de4bb0967 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:07.999094 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5f9ea-0910-4ce1-aa80-eb6de4bb0967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:08.026456 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-23a5f9ea-0910-4ce1-aa80-eb6de4bb0967 None None] MFA Rules not processed for user `87cc8f4f121148498e2b0550b09e68e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:08.028258 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-23a5f9ea-0910-4ce1-aa80-eb6de4bb0967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:08.081218 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:08.093387 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1422/2867] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:08.104589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b73c-61ef-4ae5-b010-d0ccaafe95a2 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:08.106272 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-ed02b73c-61ef-4ae5-b010-d0ccaafe95a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:08.152082 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:08.165149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b73c-61ef-4ae5-b010-d0ccaafe95a2 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:08.169460 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663e7a8-b793-4ed4-8684-8687cafada9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68cb539d18194ce6a0ad60f206699d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:08.170231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663e7a8-b793-4ed4-8684-8687cafada9a service cinder] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:08.170581 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663e7a8-b793-4ed4-8684-8687cafada9a service cinder] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:08.170863 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663e7a8-b793-4ed4-8684-8687cafada9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:08.182313 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663e7a8-b793-4ed4-8684-8687cafada9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:08.184322 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663e7a8-b793-4ed4-8684-8687cafada9a service cinder] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:08.194776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1446/2868] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:08.397936 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5f9ea-0910-4ce1-aa80-eb6de4bb0967 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:08.403191 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-23a5f9ea-0910-4ce1-aa80-eb6de4bb0967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:08.474264 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5f9ea-0910-4ce1-aa80-eb6de4bb0967 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:08.478803 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:08.479679 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:08.479964 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:08.480239 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] PATH_INFO: `/v3/projects/bd0266c35d454cb9a7fc8568babd43e0` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:08.481435 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0266c35d454cb9a7fc8568babd43e0)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:08.483465 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:08.645370 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0266c35d454cb9a7fc8568babd43e0', 'request_id': 'req-51c0ae99-01cd-46d0-bf65-461b1dcd911d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:08.652195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0266c35d454cb9a7fc8568babd43e0', 'request_id': 'req-51c0ae99-01cd-46d0-bf65-461b1dcd911d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:08.657628 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0266c35d454cb9a7fc8568babd43e0', 'request_id': 'req-51c0ae99-01cd-46d0-bf65-461b1dcd911d'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:08.770093 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] The token cache is being invalidate because project bd0266c35d454cb9a7fc8568babd43e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97428) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:08.770388 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:08.771010 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-51c0ae99-01cd-46d0-bf65-461b1dcd911d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:08.772588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1423/2869] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:13:08 2022] DELETE /identity/v3/projects/bd0266c35d454cb9a7fc8568babd43e0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:08.777826 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9172c7-0758-472c-af1b-04ef54336d90 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:08.778309 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9172c7-0758-472c-af1b-04ef54336d90 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:08.778517 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9172c7-0758-472c-af1b-04ef54336d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:08.796280 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-8e9172c7-0758-472c-af1b-04ef54336d90 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:08.798320 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-8e9172c7-0758-472c-af1b-04ef54336d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:08.856941 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1447/2870] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:08.878753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fdf3c-aaf0-4e3e-96bc-8260f6ec6212 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:08.878753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fdf3c-aaf0-4e3e-96bc-8260f6ec6212 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:08.878753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fdf3c-aaf0-4e3e-96bc-8260f6ec6212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:08.878753 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:08.886629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f52fdf3c-aaf0-4e3e-96bc-8260f6ec6212 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:08.887839 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f52fdf3c-aaf0-4e3e-96bc-8260f6ec6212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:08.895642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1424/2871] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:08.899875 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9172c7-0758-472c-af1b-04ef54336d90 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:08.916710 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9172c7-0758-472c-af1b-04ef54336d90 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:08.923589 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa9ae-6dcb-4931-a17e-cbfec916a7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:08.924254 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa9ae-6dcb-4931-a17e-cbfec916a7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:08.924540 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa9ae-6dcb-4931-a17e-cbfec916a7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:08.924811 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa9ae-6dcb-4931-a17e-cbfec916a7d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:08.925539 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa9ae-6dcb-4931-a17e-cbfec916a7d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97429) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:13:08.925846 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa9ae-6dcb-4931-a17e-cbfec916a7d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:08.927435 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa9ae-6dcb-4931-a17e-cbfec916a7d8 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:08.940502 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1448/2872] 10.222.0.93 () {58 vars in 1152 bytes} [Thu May 26 17:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:13:08.944457 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fdf3c-aaf0-4e3e-96bc-8260f6ec6212 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:08.954587 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fdf3c-aaf0-4e3e-96bc-8260f6ec6212 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:08.959183 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c342c-a95c-4caf-88d0-552a43396d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:08.959855 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c342c-a95c-4caf-88d0-552a43396d72 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:08.960134 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c342c-a95c-4caf-88d0-552a43396d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:08.960504 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c342c-a95c-4caf-88d0-552a43396d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:08.961196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c342c-a95c-4caf-88d0-552a43396d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:08.963120 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c342c-a95c-4caf-88d0-552a43396d72 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:09.066989 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1425/2873] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:13:08 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:09.074200 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa9ae-6dcb-4931-a17e-cbfec916a7d8 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:09.084368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa9ae-6dcb-4931-a17e-cbfec916a7d8 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:09.148055 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c022-fe78-4918-ae95-97d07b2e3a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:09.148689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c022-fe78-4918-ae95-97d07b2e3a8f admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:09.149031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c022-fe78-4918-ae95-97d07b2e3a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:09.149311 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c022-fe78-4918-ae95-97d07b2e3a8f admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:09.150011 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c022-fe78-4918-ae95-97d07b2e3a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:09.151995 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c022-fe78-4918-ae95-97d07b2e3a8f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:09.259913 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1449/2874] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:13:09 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:13:09.264100 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c342c-a95c-4caf-88d0-552a43396d72 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:09.275531 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c342c-a95c-4caf-88d0-552a43396d72 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:09.280617 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30e501-2cb3-408b-8e0d-4d7145214f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:09.281274 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30e501-2cb3-408b-8e0d-4d7145214f55 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:09.281560 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30e501-2cb3-408b-8e0d-4d7145214f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:09.281837 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30e501-2cb3-408b-8e0d-4d7145214f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:09.282588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30e501-2cb3-408b-8e0d-4d7145214f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:09.284214 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30e501-2cb3-408b-8e0d-4d7145214f55 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:09.295346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1426/2875] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:09.299443 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c022-fe78-4918-ae95-97d07b2e3a8f admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:09.310486 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c022-fe78-4918-ae95-97d07b2e3a8f admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:09.315316 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3eceb-9076-46b1-bd37-e9610794b542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:09.320260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3eceb-9076-46b1-bd37-e9610794b542 admin admin] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:09.320260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3eceb-9076-46b1-bd37-e9610794b542 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:09.320260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3eceb-9076-46b1-bd37-e9610794b542 admin admin] PATH_INFO: `/v3/roles` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:09.320260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3eceb-9076-46b1-bd37-e9610794b542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:09.320260 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3eceb-9076-46b1-bd37-e9610794b542 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:09.329314 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1450/2876] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:09.333539 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30e501-2cb3-408b-8e0d-4d7145214f55 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:09.344583 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30e501-2cb3-408b-8e0d-4d7145214f55 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:09.349448 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e49c4d-ba83-4a44-9e16-2cf97e50e06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:09.357722 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e49c4d-ba83-4a44-9e16-2cf97e50e06d admin admin] REQUEST_METHOD: `PUT` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:09.357722 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e49c4d-ba83-4a44-9e16-2cf97e50e06d admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:09.357722 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e49c4d-ba83-4a44-9e16-2cf97e50e06d admin admin] PATH_INFO: `/v3/projects/ba82c3d91d774a0fb052e297f4477fe0/users/20b376fbeb5a43a3a40f18e43c4d10d1/roles/9921f4d7024b4fec93767ff982451ef7` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:09.366137 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e49c4d-ba83-4a44-9e16-2cf97e50e06d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba82c3d91d774a0fb052e297f4477fe0, user_id=20b376fbeb5a43a3a40f18e43c4d10d1, role_id=9921f4d7024b4fec93767ff982451ef7)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:09.369442 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e49c4d-ba83-4a44-9e16-2cf97e50e06d admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:09.447041 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1427/2877] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:13:09 2022] PUT /identity/v3/projects/ba82c3d91d774a0fb052e297f4477fe0/users/20b376fbeb5a43a3a40f18e43c4d10d1/roles/9921f4d7024b4fec93767ff982451ef7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:09.452099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867920-2c20-400d-8c41-e9a10382b0e8 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:09.452392 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867920-2c20-400d-8c41-e9a10382b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:09.452677 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867920-2c20-400d-8c41-e9a10382b0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:09.471024 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-f8867920-2c20-400d-8c41-e9a10382b0e8 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:09.472284 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-f8867920-2c20-400d-8c41-e9a10382b0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:09.491257 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:09.531239 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1451/2878] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:09.541247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e49c4d-ba83-4a44-9e16-2cf97e50e06d admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:09.543129 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-96e49c4d-ba83-4a44-9e16-2cf97e50e06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:09.599237 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e49c4d-ba83-4a44-9e16-2cf97e50e06d admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:09.603756 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873474e7-9613-4e31-beb0-32df3645ceb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:09.604405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873474e7-9613-4e31-beb0-32df3645ceb9 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:09.604685 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873474e7-9613-4e31-beb0-32df3645ceb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:09.604956 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873474e7-9613-4e31-beb0-32df3645ceb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:09.614363 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873474e7-9613-4e31-beb0-32df3645ceb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:09.615847 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873474e7-9613-4e31-beb0-32df3645ceb9 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:09.625515 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1428/2879] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:15.106894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8c92e-c9fd-4d95-8b0b-7c7200259aee None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:15.106894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8c92e-c9fd-4d95-8b0b-7c7200259aee None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:15.106894 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8c92e-c9fd-4d95-8b0b-7c7200259aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:15.139689 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-04f8c92e-c9fd-4d95-8b0b-7c7200259aee None None] MFA Rules not processed for user `20b376fbeb5a43a3a40f18e43c4d10d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:15.141149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-04f8c92e-c9fd-4d95-8b0b-7c7200259aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:15.243378 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1452/2880] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:15.244594 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873474e7-9613-4e31-beb0-32df3645ceb9 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:15.255405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873474e7-9613-4e31-beb0-32df3645ceb9 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:15.261514 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b339d4-0794-4f9c-b93d-28433a650fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:15.262165 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b339d4-0794-4f9c-b93d-28433a650fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:15.262451 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b339d4-0794-4f9c-b93d-28433a650fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:15.262724 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b339d4-0794-4f9c-b93d-28433a650fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:15.263482 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b339d4-0794-4f9c-b93d-28433a650fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:15.265427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b339d4-0794-4f9c-b93d-28433a650fa5 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:15.364780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1429/2881] 10.222.0.93 () {60 vars in 1152 bytes} [Thu May 26 17:13:15 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:13:15.369651 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8c92e-c9fd-4d95-8b0b-7c7200259aee None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:15.382462 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8c92e-c9fd-4d95-8b0b-7c7200259aee None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:15.473480 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a9e31-f113-4e69-839c-133cfe9049b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:15.474586 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9e31-f113-4e69-839c-133cfe9049b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:15.475043 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9e31-f113-4e69-839c-133cfe9049b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:15.476113 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9e31-f113-4e69-839c-133cfe9049b3 admin admin] PATH_INFO: `/v3/users` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:15.477004 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a9e31-f113-4e69-839c-133cfe9049b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:15.479494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a9e31-f113-4e69-839c-133cfe9049b3 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:15.645790 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b339d4-0794-4f9c-b93d-28433a650fa5 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:15.653714 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1453/2882] 10.222.0.93 () {60 vars in 1143 bytes} [Thu May 26 17:13:15 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:13:15.658650 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b339d4-0794-4f9c-b93d-28433a650fa5 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:15.676658 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b11981-affa-44d8-98be-19eef0013387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:15.677471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11981-affa-44d8-98be-19eef0013387 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:15.678494 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11981-affa-44d8-98be-19eef0013387 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:15.679022 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11981-affa-44d8-98be-19eef0013387 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:15.680344 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b11981-affa-44d8-98be-19eef0013387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:15.682485 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b11981-affa-44d8-98be-19eef0013387 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:15.702164 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1430/2883] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:13:15.706085 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a9e31-f113-4e69-839c-133cfe9049b3 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:15.719116 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a9e31-f113-4e69-839c-133cfe9049b3 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:15.727434 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a8798-a445-46cf-9b6c-19998288f324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:15.735503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a8798-a445-46cf-9b6c-19998288f324 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:15.735503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a8798-a445-46cf-9b6c-19998288f324 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:15.735503 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a8798-a445-46cf-9b6c-19998288f324 admin admin] PATH_INFO: `/v3/projects/24603fe069d74177bbd910b9d26ceadb/users/cd1fcd20a2ea4d479ec29d40fa9cbda1/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:15.748368 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a8798-a445-46cf-9b6c-19998288f324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24603fe069d74177bbd910b9d26ceadb, user_id=cd1fcd20a2ea4d479ec29d40fa9cbda1, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:15.751047 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a8798-a445-46cf-9b6c-19998288f324 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:15.826945 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1454/2884] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:13:15 2022] PUT /identity/v3/projects/24603fe069d74177bbd910b9d26ceadb/users/cd1fcd20a2ea4d479ec29d40fa9cbda1/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:13:15.835735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b11981-affa-44d8-98be-19eef0013387 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:15.846154 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b11981-affa-44d8-98be-19eef0013387 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:15.894878 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:15.909804 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c183c-189f-4616-8104-033be1b672c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:15.910568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c183c-189f-4616-8104-033be1b672c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:15.910743 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c183c-189f-4616-8104-033be1b672c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:15.911018 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c183c-189f-4616-8104-033be1b672c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:15.911809 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c183c-189f-4616-8104-033be1b672c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:15.913403 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c183c-189f-4616-8104-033be1b672c3 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:15.924568 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1431/2885] 10.222.0.93 () {58 vars in 1121 bytes} [Thu May 26 17:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:13:15.928494 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a8798-a445-46cf-9b6c-19998288f324 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:15.943841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a8798-a445-46cf-9b6c-19998288f324 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:15.944887 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4e537-4248-4a5f-9f25-18201ddd4a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:15.945774 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4e537-4248-4a5f-9f25-18201ddd4a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:15.946052 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4e537-4248-4a5f-9f25-18201ddd4a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:15.946327 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4e537-4248-4a5f-9f25-18201ddd4a28 admin admin] PATH_INFO: `/v3/projects/24603fe069d74177bbd910b9d26ceadb/users/cd1fcd20a2ea4d479ec29d40fa9cbda1/roles/0929ca3f300846b0915f3e24f5ffd382` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:15.948915 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4e537-4248-4a5f-9f25-18201ddd4a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24603fe069d74177bbd910b9d26ceadb, user_id=cd1fcd20a2ea4d479ec29d40fa9cbda1, role_id=0929ca3f300846b0915f3e24f5ffd382)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:15.954243 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4e537-4248-4a5f-9f25-18201ddd4a28 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:15.968527 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1455/2886] 10.222.0.93 () {60 vars in 1482 bytes} [Thu May 26 17:13:15 2022] PUT /identity/v3/projects/24603fe069d74177bbd910b9d26ceadb/users/cd1fcd20a2ea4d479ec29d40fa9cbda1/roles/0929ca3f300846b0915f3e24f5ffd382 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:20.387409 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c183c-189f-4616-8104-033be1b672c3 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:20.389324 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5a2c183c-189f-4616-8104-033be1b672c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:20.403149 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c183c-189f-4616-8104-033be1b672c3 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:20.471249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:20.472244 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:20.472602 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:20.472940 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] PATH_INFO: `/v3/users/87cc8f4f121148498e2b0550b09e68e2` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:20.474196 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cc8f4f121148498e2b0550b09e68e2)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:20.476316 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:20.702791 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cc8f4f121148498e2b0550b09e68e2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:20.710290 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cc8f4f121148498e2b0550b09e68e2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:20.710979 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cc8f4f121148498e2b0550b09e68e2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:20.724728 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cc8f4f121148498e2b0550b09e68e2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:20.725635 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cc8f4f121148498e2b0550b09e68e2'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:20.812886 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1432/2887] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:13:20 2022] DELETE /identity/v3/users/87cc8f4f121148498e2b0550b09e68e2 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:20.817117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e7f7-9172-4743-9125-9c82ec64a131 None None] REQUEST_METHOD: `POST` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:20.817654 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e7f7-9172-4743-9125-9c82ec64a131 None None] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:20.817759 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e7f7-9172-4743-9125-9c82ec64a131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:20.836739 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:20.843427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.auth.core [None req-3072e7f7-9172-4743-9125-9c82ec64a131 None None] MFA Rules not processed for user `35335aa619474ed5a5f6b04e6a89efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97429) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:20.844657 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3072e7f7-9172-4743-9125-9c82ec64a131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:20.912672 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1456/2888] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:20.924676 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:20.928766 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:20.986672 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cd8a6-7294-4472-9435-8d5f63fa59ff admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:20.990283 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ffb7d-0d53-44c8-bb3e-dc942115b9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:20.990954 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ffb7d-0d53-44c8-bb3e-dc942115b9cc service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:20.991242 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ffb7d-0d53-44c8-bb3e-dc942115b9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:20.991522 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ffb7d-0d53-44c8-bb3e-dc942115b9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:21.000761 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ffb7d-0d53-44c8-bb3e-dc942115b9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:21.002202 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ffb7d-0d53-44c8-bb3e-dc942115b9cc service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:21.012610 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1433/2889] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:21.458348 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072e7f7-9172-4743-9125-9c82ec64a131 None None] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:21.471117 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-3072e7f7-9172-4743-9125-9c82ec64a131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:21.484620 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072e7f7-9172-4743-9125-9c82ec64a131 None None] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:21.490496 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:21.492807 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:21.494099 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:21.495050 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] PATH_INFO: `/v3/projects/9310407185ae4b9fa2601fa4469eaff2` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:21.496399 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9310407185ae4b9fa2601fa4469eaff2)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:21.498643 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:21.612132 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9310407185ae4b9fa2601fa4469eaff2', 'request_id': 'req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:21.618993 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9310407185ae4b9fa2601fa4469eaff2', 'request_id': 'req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:21.625252 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9310407185ae4b9fa2601fa4469eaff2', 'request_id': 'req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:21.714088 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] The token cache is being invalidate because project 9310407185ae4b9fa2601fa4469eaff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:13:21.716049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:21.716049 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:13:21.718223 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1457/2890] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:13:21 2022] DELETE /identity/v3/projects/9310407185ae4b9fa2601fa4469eaff2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:13:22.190841 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce7a4e-a1c7-4e91-b159-afd9b095778f None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:22.191346 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce7a4e-a1c7-4e91-b159-afd9b095778f None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:22.191626 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce7a4e-a1c7-4e91-b159-afd9b095778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:22.205554 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:22.224846 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-5bce7a4e-a1c7-4e91-b159-afd9b095778f None None] MFA Rules not processed for user `cd1fcd20a2ea4d479ec29d40fa9cbda1`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:22.226261 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-5bce7a4e-a1c7-4e91-b159-afd9b095778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:22.301538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1434/2891] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:22.318035 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:22.320129 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:22.400652 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93548e-17ee-4e49-994c-41fd2ca2bc4a admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:22.406140 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:22.406801 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:22.407204 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:22.407349 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:22.409251 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:22.438984 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:22.476149 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:22.477829 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:22.488191 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1458/2892] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:25.648842 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172975-1261-4b66-9c36-5c1c62fd4e04 None None] REQUEST_METHOD: `POST` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:25.651148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172975-1261-4b66-9c36-5c1c62fd4e04 None None] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:25.651148 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172975-1261-4b66-9c36-5c1c62fd4e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:25.667709 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.auth.core [None req-f7172975-1261-4b66-9c36-5c1c62fd4e04 None None] MFA Rules not processed for user `20b376fbeb5a43a3a40f18e43c4d10d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97428) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:13:25.668928 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f7172975-1261-4b66-9c36-5c1c62fd4e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:25.679236 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1435/2893] 10.222.0.93 () {58 vars in 957 bytes} [Thu May 26 17:13:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:13:29.996604 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:29.998037 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:30.070303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2384ea2-ed4a-4592-8ce4-81cb014408b2 service nova] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:30.075692 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702358e-ef26-4bae-9387-a416fcb0a36e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:30.076362 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702358e-ef26-4bae-9387-a416fcb0a36e service placement] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:30.076646 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702358e-ef26-4bae-9387-a416fcb0a36e service placement] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:30.076923 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702358e-ef26-4bae-9387-a416fcb0a36e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:30.078907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-6702358e-ef26-4bae-9387-a416fcb0a36e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:30.091168 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702358e-ef26-4bae-9387-a416fcb0a36e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:30.093058 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702358e-ef26-4bae-9387-a416fcb0a36e service placement] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:30.104006 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1459/2894] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:35.662553 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=34 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:39.519873 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172975-1261-4b66-9c36-5c1c62fd4e04 None None] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:39.521374 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-f7172975-1261-4b66-9c36-5c1c62fd4e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:39.577143 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172975-1261-4b66-9c36-5c1c62fd4e04 None None] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:39.580729 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:39.581360 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:39.581643 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:39.581919 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:39.583827 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:13:39.594944 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:39.596499 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:39.605314 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1436/2895] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:13:40.098676 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=47 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:49.600971 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=26 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:13:52.146359 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702358e-ef26-4bae-9387-a416fcb0a36e service placement] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:13:52.156427 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702358e-ef26-4bae-9387-a416fcb0a36e service placement] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:13:52.160121 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe16e8-dc41-4bab-b24d-6ec8a21d6600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:13:52.160750 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe16e8-dc41-4bab-b24d-6ec8a21d6600 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:13:52.161031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe16e8-dc41-4bab-b24d-6ec8a21d6600 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:13:52.161305 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe16e8-dc41-4bab-b24d-6ec8a21d6600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:13:52.170860 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe16e8-dc41-4bab-b24d-6ec8a21d6600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:13:52.172479 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe16e8-dc41-4bab-b24d-6ec8a21d6600 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:13:52.183138 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1460/2896] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:13:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:14:02.177907 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=6 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:33.398445 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:33.400444 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:33.460134 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52238d-bea3-4b00-898f-6dc647bd0141 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:33.463735 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d719c-92d9-4690-8e91-8d4f13e14502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:33.464362 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d719c-92d9-4690-8e91-8d4f13e14502 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:33.464640 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d719c-92d9-4690-8e91-8d4f13e14502 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:33.464911 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d719c-92d9-4690-8e91-8d4f13e14502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:33.466912 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-ff2d719c-92d9-4690-8e91-8d4f13e14502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:33.476427 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d719c-92d9-4690-8e91-8d4f13e14502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:33.477862 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d719c-92d9-4690-8e91-8d4f13e14502 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:33.485629 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1437/2897] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:15:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:15:43.482104 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=28 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:15:49.588558 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe16e8-dc41-4bab-b24d-6ec8a21d6600 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:49.617707 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe16e8-dc41-4bab-b24d-6ec8a21d6600 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:49.622069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4cf0-291b-4b6c-a871-45fa4e0f0e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:49.622708 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4cf0-291b-4b6c-a871-45fa4e0f0e79 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:49.622991 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4cf0-291b-4b6c-a871-45fa4e0f0e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:49.623265 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4cf0-291b-4b6c-a871-45fa4e0f0e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:49.625090 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-682c4cf0-291b-4b6c-a871-45fa4e0f0e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:49.659016 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4cf0-291b-4b6c-a871-45fa4e0f0e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:49.660481 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4cf0-291b-4b6c-a871-45fa4e0f0e79 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:49.672159 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1461/2898] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:15:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:15:50.849296 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d719c-92d9-4690-8e91-8d4f13e14502 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:15:50.857922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d719c-92d9-4690-8e91-8d4f13e14502 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:15:50.861581 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ac31c-cd09-4cf7-ba14-a87756667a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:15:50.862217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ac31c-cd09-4cf7-ba14-a87756667a92 service neutron] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:15:50.862502 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ac31c-cd09-4cf7-ba14-a87756667a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:15:50.862780 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ac31c-cd09-4cf7-ba14-a87756667a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:15:50.864571 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-873ac31c-cd09-4cf7-ba14-a87756667a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:15:50.878105 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ac31c-cd09-4cf7-ba14-a87756667a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:15:50.879529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ac31c-cd09-4cf7-ba14-a87756667a92 service neutron] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:15:50.890920 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1438/2899] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:15:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:15:59.666448 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=24 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:00.885471 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=6 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:04.121031 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4cf0-291b-4b6c-a871-45fa4e0f0e79 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:16:04.131026 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4cf0-291b-4b6c-a871-45fa4e0f0e79 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:16:04.134719 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dc042-79ec-44ea-8537-d55187c15f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:16:04.135374 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dc042-79ec-44ea-8537-d55187c15f05 service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:16:04.135682 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dc042-79ec-44ea-8537-d55187c15f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:16:04.135992 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dc042-79ec-44ea-8537-d55187c15f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:16:04.137762 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d65dc042-79ec-44ea-8537-d55187c15f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:16:04.148212 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65dc042-79ec-44ea-8537-d55187c15f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:16:04.149639 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65dc042-79ec-44ea-8537-d55187c15f05 service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:16:04.158576 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1462/2900] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:16:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:16:04.432391 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ac31c-cd09-4cf7-ba14-a87756667a92 service neutron] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:16:04.444021 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ac31c-cd09-4cf7-ba14-a87756667a92 service neutron] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:16:04.449588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6d2e-21b1-4c97-8b52-5183deaa441e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:16:04.450249 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6d2e-21b1-4c97-8b52-5183deaa441e service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:16:04.450573 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6d2e-21b1-4c97-8b52-5183deaa441e service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:16:04.450851 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6d2e-21b1-4c97-8b52-5183deaa441e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:16:04.452636 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-fdcb6d2e-21b1-4c97-8b52-5183deaa441e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:16:04.465327 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb6d2e-21b1-4c97-8b52-5183deaa441e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:16:04.467150 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb6d2e-21b1-4c97-8b52-5183deaa441e service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:16:04.478334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1439/2901] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:16:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:16:05.251356 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dc042-79ec-44ea-8537-d55187c15f05 service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:16:05.260346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dc042-79ec-44ea-8537-d55187c15f05 service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:16:05.264096 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fee665c10364944a8162548f91a431e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:16:05.264741 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:16:05.265030 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:16:05.265354 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:16:05.267765 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:16:05.282588 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:16:05.284069 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:16:05.296187 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1463/2902] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:16:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:16:05.380588 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6d2e-21b1-4c97-8b52-5183deaa441e service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:16:05.392915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6d2e-21b1-4c97-8b52-5183deaa441e service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:16:05.398309 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24763a7f-ff74-4fcc-8a1d-20194fd6ab48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:16:05.398579 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24763a7f-ff74-4fcc-8a1d-20194fd6ab48 service placement] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:16:05.398866 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24763a7f-ff74-4fcc-8a1d-20194fd6ab48 service placement] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:16:05.399144 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24763a7f-ff74-4fcc-8a1d-20194fd6ab48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:16:05.400977 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-24763a7f-ff74-4fcc-8a1d-20194fd6ab48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:16:05.413797 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24763a7f-ff74-4fcc-8a1d-20194fd6ab48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:16:05.415443 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24763a7f-ff74-4fcc-8a1d-20194fd6ab48 service placement] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:16:05.426131 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1440/2903] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:16:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:16:15.290800 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=12 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:16:15.421418 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=12 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:17:34.910178 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:34.912690 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:34.964156 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb00d3-b604-4915-ae6e-25c6b985fdcb service neutron] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:34.970541 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:34.971365 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:34.971776 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:34.972752 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:34.974841 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:34.989590 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:34.991418 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:35.004001 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1464/2904] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:17:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:17:38.022967 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24763a7f-ff74-4fcc-8a1d-20194fd6ab48 service placement] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:38.035550 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24763a7f-ff74-4fcc-8a1d-20194fd6ab48 service placement] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:38.040963 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8a5a74a2947e385ca0cb7f3ee6428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:38.041589 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:38.041871 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:38.042200 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:38.043946 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:38.056488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:38.058068 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:38.068538 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1441/2905] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:17:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:17:43.786032 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:43.787703 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:43.824538 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234ab9f-6ead-492b-b362-0aacb6f988e2 service nova] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:43.829950 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1d60-72eb-405d-88de-0b4533b3115e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:43.830636 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1d60-72eb-405d-88de-0b4533b3115e service placement] REQUEST_METHOD: `GET` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:43.830916 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1d60-72eb-405d-88de-0b4533b3115e service placement] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:43.831231 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1d60-72eb-405d-88de-0b4533b3115e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:43.833161 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-2e2e1d60-72eb-405d-88de-0b4533b3115e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:43.845238 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e1d60-72eb-405d-88de-0b4533b3115e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:43.846911 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e1d60-72eb-405d-88de-0b4533b3115e service placement] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:43.858123 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1465/2906] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:17:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:17:47.492655 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:47.494145 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:47.593890 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf338b1-5926-4bfc-baeb-3f8024ebc4ad service nova] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:47.599459 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:47.600358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:47.600642 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:47.600922 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] PATH_INFO: `/v3/users/20b376fbeb5a43a3a40f18e43c4d10d1` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:47.602125 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b376fbeb5a43a3a40f18e43c4d10d1)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:47.604078 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:47.782929 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b376fbeb5a43a3a40f18e43c4d10d1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:47.789708 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b376fbeb5a43a3a40f18e43c4d10d1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:47.790358 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b376fbeb5a43a3a40f18e43c4d10d1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:47.801853 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b376fbeb5a43a3a40f18e43c4d10d1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:47.802475 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b376fbeb5a43a3a40f18e43c4d10d1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:47.905882 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1442/2907] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:17:47 2022] DELETE /identity/v3/users/20b376fbeb5a43a3a40f18e43c4d10d1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:17:48.145767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1d60-72eb-405d-88de-0b4533b3115e service placement] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:48.158436 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1d60-72eb-405d-88de-0b4533b3115e service placement] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:48.232485 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:48.233413 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:48.233705 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:48.234142 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] PATH_INFO: `/v3/projects/ba82c3d91d774a0fb052e297f4477fe0` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:48.235339 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba82c3d91d774a0fb052e297f4477fe0)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:48.237306 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:48.344994 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba82c3d91d774a0fb052e297f4477fe0', 'request_id': 'req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.351790 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba82c3d91d774a0fb052e297f4477fe0', 'request_id': 'req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.357704 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba82c3d91d774a0fb052e297f4477fe0', 'request_id': 'req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.423218 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] The token cache is being invalidate because project ba82c3d91d774a0fb052e297f4477fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:17:48.423583 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.424213 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.425767 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1466/2908] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:17:48 2022] DELETE /identity/v3/projects/ba82c3d91d774a0fb052e297f4477fe0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:17:48.430221 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:48.431651 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:48.444678 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2472b3-89fa-4d05-be28-5a2cff00d008 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:48.479334 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:17:48.502108 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:48.502974 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:48.503254 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:48.503529 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] PATH_INFO: `/v3/users/cd1fcd20a2ea4d479ec29d40fa9cbda1` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:48.504744 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1fcd20a2ea4d479ec29d40fa9cbda1)` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:48.506719 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:48.712405 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1fcd20a2ea4d479ec29d40fa9cbda1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.719489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1fcd20a2ea4d479ec29d40fa9cbda1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.720199 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1fcd20a2ea4d479ec29d40fa9cbda1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.732452 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1fcd20a2ea4d479ec29d40fa9cbda1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.733079 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.notifications [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1fcd20a2ea4d479ec29d40fa9cbda1'} {{(pid=97428) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:48.805915 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1443/2909] 10.222.0.93 () {58 vars in 1223 bytes} [Thu May 26 17:17:48 2022] DELETE /identity/v3/users/cd1fcd20a2ea4d479ec29d40fa9cbda1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:17:49.073551 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] Authenticating user token {{(pid=97429) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:17:49.075164 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.fernet_utils [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97429) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:17:49.088959 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adf2ed-6d75-40a8-a94b-6e25ad920e85 admin admin] Validating token access rules against request {{(pid=97429) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:17:49.103642 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:17:49.147737 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35335aa619474ed5a5f6b04e6a89efaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dee3d9410543e8a4d913fcc504aee9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97429) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:17:49.148591 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:17:49.148872 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:17:49.149146 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] PATH_INFO: `/v3/projects/24603fe069d74177bbd910b9d26ceadb` {{(pid=97429) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:17:49.150346 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24603fe069d74177bbd910b9d26ceadb)` {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:17:49.152513 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] RBAC: Authorization granted {{(pid=97429) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:17:49.253830 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24603fe069d74177bbd910b9d26ceadb', 'request_id': 'req-b90dbb72-2cff-4d91-b7b4-ed131679a71f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:49.260281 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24603fe069d74177bbd910b9d26ceadb', 'request_id': 'req-b90dbb72-2cff-4d91-b7b4-ed131679a71f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:49.265621 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24603fe069d74177bbd910b9d26ceadb', 'request_id': 'req-b90dbb72-2cff-4d91-b7b4-ed131679a71f'} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:49.327501 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] The token cache is being invalidate because project 24603fe069d74177bbd910b9d26ceadb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97429) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:17:49.327744 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:49.328352 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG keystone.notifications [None req-b90dbb72-2cff-4d91-b7b4-ed131679a71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97429) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:17:49.329935 dv-cinder-836070-4-smb devstack@keystone.service[97429]: [pid: 97429|app: 0|req: 1467/2910] 10.222.0.93 () {58 vars in 1232 bytes} [Thu May 26 17:17:49 2022] DELETE /identity/v3/projects/24603fe069d74177bbd910b9d26ceadb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:17:58.917505 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:17:59.324303 dv-cinder-836070-4-smb devstack@keystone.service[97429]: DEBUG dbcounter [-] [97429] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:18:34.886526 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] Authenticating user token {{(pid=97428) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:18:34.888489 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:18:34.960632 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeae697-b347-4a45-a11c-20af38793521 admin admin] Validating token access rules against request {{(pid=97428) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:18:35.020302 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471df2-cf33-4409-8a19-de8d5118e002 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae184afff284dcaa228859902e92191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4c6817f30f44a419df3cf313c189439', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97428) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:18:35.020938 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471df2-cf33-4409-8a19-de8d5118e002 service placement] REQUEST_METHOD: `GET` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:18:35.021217 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471df2-cf33-4409-8a19-de8d5118e002 service placement] SCRIPT_NAME: `/identity` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:18:35.021488 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471df2-cf33-4409-8a19-de8d5118e002 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97428) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:18:35.023247 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.fernet_utils [None req-75471df2-cf33-4409-8a19-de8d5118e002 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97428) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:18:35.034195 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75471df2-cf33-4409-8a19-de8d5118e002 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:18:35.035776 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75471df2-cf33-4409-8a19-de8d5118e002 service placement] RBAC: Authorization granted {{(pid=97428) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:18:35.045433 dv-cinder-836070-4-smb devstack@keystone.service[97428]: [pid: 97428|app: 0|req: 1444/2911] 10.222.0.93 () {60 vars in 1365 bytes} [Thu May 26 17:18:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:18:45.041229 dv-cinder-836070-4-smb devstack@keystone.service[97428]: DEBUG dbcounter [-] [97428] Writing DB stats keystone:SELECT=58 {{(pid=97428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}